Just want to know i got different blocked urls stats at webmaster. I blocked entire site for revamp and latest builds implementation. Here are different stats Under Health tab> Blocked URls>2,580 ...
Set initial robots.txt restrictions so high, Googlebot won't even try to access the updated less strict file.
When I initially setup my blog I put the restrictions on robots.txt way too high. They were so stick that googlebot can't even access the udated less strict robots file. I've been at this problem for ...
I usually disallow subdirectories in the robots.txt file and I was wondering if it's possible to do it the other way: block everything and list the main index file and the others pages I'd like search ...
Currently my site is being crawled by the Googlebot on a daily basis. Is a daily crawl from the Googlebot a good thing or bad thing?
I noticed recently that Google is not caching all of the pages on my website. Upon using the Google webmaster diagnostic tool, I realized that some of my pages were being restricted by entries in my ...