All Questions
4 questions
0
votes
0
answers
44
views
In my Crawl Stats, 23% of requests are "Unauthorized" - is that bad?
Am I correct in thinking that having 23% of all crawl requests being blocked by "Unauthorized" 401/407 is NOT good?
68% of my crawl requests return 200 (OK) which is good of course.
Is this ...
- 425
4
votes
2
answers
146
views
Increase in 5XX errors and 404 errors on GWT, are we under attack?
A lot of URLs are suddenly giving us 404s and 500s.
On closer inspection, these URLs do not exist on our website and are being linked from random sources.
As more URLs were inspected on GWT, a lot ...
- 689
1
vote
1
answer
673
views
Google Bot Crawler Issue with Codeigniter URLS
I received 6000+ crawler errors in my webmaster tools account. following is the one of the URL that identified as problematic URL.
http://www.example.com/segment1/segment2&sa=U&ved=...
- 111
1
vote
2
answers
95
views
What to do about crawler errors after removing non-essential parts of my website?
So, recently I was re-building my website, putting on another CMS, optimizing and so on. Now I visited Google Webmaster tools and it tells I have a lot of Web crawler 404 not found errors.
I am ...