All Questions
9 questions
1
vote
1
answer
49
views
What is the Query to add in robots.txt for blocking URLs has some special characters?
I was going through the Google Search Console pages issues and one of the issue reason is "Alternate page with proper canonical tag" and this has some URLs which look like below
example.com/...
3
votes
2
answers
520
views
Google Search Console: 404 errors on existing pages
There is a few years old small website with very few pages (~5), which were indexed and ranked by Google. A few days ago 4 of those pages disappeared from SERPs and Search Console gives me 404 Not ...
- 173
5
votes
1
answer
194
views
Can Googlebot discover URLs that are not in an anchor?
In my Search Console I had a sudden increase in 404's.
They were linked from a webpage that listed files from the site in a table but none of these URLs were nested inside an <a> tag.
This was ...
- 1,187
4
votes
2
answers
146
views
Increase in 5XX errors and 404 errors on GWT, are we under attack?
A lot of URLs are suddenly giving us 404s and 500s.
On closer inspection, these URLs do not exist on our website and are being linked from random sources.
As more URLs were inspected on GWT, a lot ...
- 689
1
vote
2
answers
95
views
What to do about crawler errors after removing non-essential parts of my website?
So, recently I was re-building my website, putting on another CMS, optimizing and so on. Now I visited Google Webmaster tools and it tells I have a lot of Web crawler 404 not found errors.
I am ...
1
vote
1
answer
650
views
Google WebMaster Tools Reports a Significant Increase in 500 Response Code Errors
Google's Webmaster tools shows lots of Crawl Errors. They are reported as 500 response code.
How can I go about diagnosing this issue?
The website is eCommerce business using the Magento platform....
- 381
1
vote
3
answers
13k
views
Google Webmaster Tools - Crawl errors with 500 status code
I will try to explain the situation:
In December 2012 I deployed a website with a sitemap.xml, etc... there were circa 2000 URLs.
After a while I changed something on my website, upgrading my pages ...
- 141
2
votes
2
answers
261
views
Will setting a custom crawl rate in Google Webmaster Tools affects index or have other negative consequences?
My site was running well for the past three years. Recently Googlebot's request my server got increased. and at one time I got network unreachable error. When I contacted my hosting company they asked ...
- 745
3
votes
2
answers
152
views
How to set crawl rate in Google Webmaster Tools for seven days or a month?
My web host is blocking IPs which make many requests. This includes Googlebot. I found this by checking my webmaster tools account. There it said "network unreachable" for all the URLs which are ...
- 745