GoogleBot 404

Jonathan Plunkett asked on December 21, 2015 15:42

When I fetch the page using google webmaster tools I get a 404 for any page other than the root. When I navigate normally to the site it works. I had a look through the event log and I get: Source: Application_Error Event code: PAGENOTFOUND User agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

I'm using extensionless urls. Any ideas?

Thanks.

404 googlebot kentico 8.2

Recent Answers

Brenden Kehren answered on December 21, 2015 15:54

Do you have your sitemap setup properly? How about your robots.txt file? There's most likely a configuration in your settings that are incorrect and/or a piece missing in your content tree for your XML sitemap.

1 votesVote for this answer Mark as a Correct answer

Jonathan Plunkett answered on December 21, 2015 15:57 (last edited on December 21, 2015 15:58)

Thanks Brenden, yes they are both setup correctly. Google wont index the site because it got errors using the sitemap urls. I copied the url and hit it in the browser and it works. Ran the url through the robots.txt tester and it said there is no issues. I ran the "Fetch as google" part in the webmaaster tools and it logged that page not found event in the Event Log.

0 votesVote for this answer Mark as a Correct answer

Brenden Kehren answered on December 21, 2015 20:24

Do you have a sitemap setup in the content tree using the Google Sitemap XML webpart? Also do you have the site settings configured with this URL? Settings>URLs & SEO>Search engine optimization>Google sitemap UR and Google sitemap path. They should have settings similar to what I have here:

Image Text

The sitemap path is where the sitemap resides in your content tree. The sitemap URL is what you provide to google. For instance, www.yourdomain.com/googlesitemap.xml

1 votesVote for this answer Mark as a Correct answer