Are you talking about creating a Smart Search index or simply modifying the Search fields of a custom table? If you want to modify the Search fields of an existing custom table, select the custom table in question and click the Search Fields.

If you're talking about creating a Smart Search index, go to Administration>Smart Search and add a new Index and add as many Custom Tables to it as you need with a WHERE clause.