Tag Info

New answers tagged

5

If another website is linking to those incorrect URLs (because of a typo) and Google is following those links they will get a 404 page. They may assume that page is supposed to exist because another site is linking to them and are reporting the error to you in case you need to fix it. Naturally after a while they will stop attempting to crawl that URL ...


0

AdSense uses a crawler called Mediapartners-Google. It doesn't crawl your entire site using the sitemap. Rather, when a user requests a page with ads on it, it crawls that URL on the fly. If you are no longer serving pages with ads on those URLs, the AdSense bot will stop crawling those URLs without any intervention from you. My guess is that when ...


1

You should probably check a handful in Fetch as Google to make sure Google can find your pages. This will serve as reassurance that pages are accessible before using the MARK AS FIXED button to clear out the errors. Due to any number of configuration/DNS issues it's possible that you can see pages that Googlebot can't. A service like What's My DNS? can help ...


0

I cannot verify this authoritatively, but based on my own observations I'm going to hypothesise that once Google has cached a page, it will continue for some time to follow links from its own cached version of the page rather than from the live version of the page. As far as I can see, the two quickest ways to get around this are: 1) to re-fetch the live ...



Top 50 recent answers are included