Setting runAllManagedModulesForAllRequests="true" in web.config stops loading images

I'm not sure that you specifically need to add runAllManagedModulesForAllRequests="true" to make a robots.txt file to work. More importantly, are you placing this in the file system or in the content tree? There should be no reason to put it in the file system, place it in the content tree.

Secondly, when you view the source of the images, what is incorrect about the URL of the images? Is there a missing extension or an extra / or a ~ in front of the image URL. If so then there are a few things you may need to configure like extensions and how relative URLs are processed.

Hi,
What are the IIS settings? Are you using the Integrated pipeline mode instead of Classic?
Also, what are the URLs and SEO settings when it comes to "Files friendly URL extension"? Only one extension is allowed, to support all leave the setting empty.

What is the generated URL of the broken images?

Hi Brenden, Juraj

My robots.txt file is in the content tree. When surfing to http://mydomain.com/robots, I'm getting the item, but when surfing to http://mydomain.com/robots.txt, the following error comes: The resource you are looking for has been removed, had its name changed, or is temporarily unavailable..

My images are loaded by http://mydomain.com/media/image.jpg, in my explorer, there is <img src="/media/img.jpg" />.

I'm not using IIS, but an Azure Web App. There isn't an option on the friendly url path.

Kind regards

Kenny

I see from where this all is growing.

robots.txt has nothing to do with runAllManagedModulesForAllRequests. if you set runAllManagedModulesForAllRequests - it will run all your requests (such images, css, javascript files) through asp.net pipeline.

Do you have multiple sites running and you want to serve different robots.txt for each of the sites?

if not: "The most direct way to use robots.txt in Kentico is to physically add the text file into the root of your web project."

Hi Peter

I'm having multiple domain aliases, and some aliases should be allowed for the robots.txt file. Every domain alias has an own sitemap: located ad: http://mydomain.com/sitemap, http://mydomain1.com/sitemap, which is fixed with a macro.

So to answer your question, I think it's neccessary to have my robots.txt-file into the content tree?

Kind regards

Kenny

I have configured my multiple robot.txt in the following way:

1. Delete physical file one in the kentico root

2. Create a page with fixed route like below (might need to restart the app to get the rout working)

3. On this page add "custom response" web part for each domain:

Hi Kenny What is the broken urls and how are the images added? Thanks Ilesh

I wanted to avoid configuring anything in IIS or the app service. Here is what I've done:

1. Added runAllManagedModulesForAllRequests="true"
2. On robots.txt Page > properties > URLs: page alias = robots, path = empty, use custom url extension = true, url extensions = .txt.

Note: URLs & SEO settings didn't require any setting if you create the page underneath the root level.