Smart search indexes are represented by physical .log files and can be found in the ~/App_Data/CMSModules/SmartSearch/ folder, which is included in the web application project. You can try to explicitly exclude these log files from the project, by using the “Exclude From Project” option in the context menu of the Solution explorer in Visual Studio.
See Also: Smart search