Skip to main content

All Questions

Filter by
Sorted by
Tagged with
0 votes
0 answers
44 views

In my Crawl Stats, 23% of requests are "Unauthorized" - is that bad?

Am I correct in thinking that having 23% of all crawl requests being blocked by "Unauthorized" 401/407 is NOT good? 68% of my crawl requests return 200 (OK) which is good of course. Is this ...
Henry's user avatar
  • 425
3 votes
2 answers
520 views

Google Search Console: 404 errors on existing pages

There is a few years old small website with very few pages (~5), which were indexed and ranked by Google. A few days ago 4 of those pages disappeared from SERPs and Search Console gives me 404 Not ...
neptune's user avatar
  • 173
5 votes
1 answer
194 views

Can Googlebot discover URLs that are not in an anchor?

In my Search Console I had a sudden increase in 404's. They were linked from a webpage that listed files from the site in a table but none of these URLs were nested inside an <a> tag. This was ...
GrapeSoda's user avatar
  • 1,187
4 votes
2 answers
146 views

Increase in 5XX errors and 404 errors on GWT, are we under attack?

A lot of URLs are suddenly giving us 404s and 500s. On closer inspection, these URLs do not exist on our website and are being linked from random sources. As more URLs were inspected on GWT, a lot ...
CP3O's user avatar
  • 689
1 vote
1 answer
673 views

Google Bot Crawler Issue with Codeigniter URLS

I received 6000+ crawler errors in my webmaster tools account. following is the one of the URL that identified as problematic URL. http://www.example.com/segment1/segment2&sa=U&ved=...
Razor Jack's user avatar
2 votes
2 answers
261 views

Will setting a custom crawl rate in Google Webmaster Tools affects index or have other negative consequences?

My site was running well for the past three years. Recently Googlebot's request my server got increased. and at one time I got network unreachable error. When I contacted my hosting company they asked ...
Jayapal Chandran's user avatar