Hi everyone, we have a product/vehicle listing section with multiple filtering options (facets) which generate dynamic parameters in the URLs. I want to prevent Googlebot from wasting our crawl budget on duplicate or low-value filter combinations.
In Kentico, what is the recommended approach to handle this? Should we rely strictly on canonical tags, use the robots.txt to disallow specific URL parameters, or is there a native way within Kentico's routing system to manage parameterized URLs for search crawlers? Thanks!