When I initially setup my blog I put the restrictions on robots.txt way too high. They were so stick that googlebot can't even access the udated less strict robots file. I've been at this problem for days, I'm in a bind. I will be extremely grateful if someone could help me out.
Tell me more
×
Webmasters Stack Exchange is a question and answer site for
pro webmasters. It's 100% free, no registration required.
|
migrated from wordpress.stackexchange.com Sep 8 '12 at 12:06
|
I'm not sure I 100% understand your question (you should add a snippet of your robots.txt rules to get a definitive answer) Sill, from what I read here you must have a Also, before doing anything, go into Google Webmaster Tools and use "Fetch as Googlebot" (under "Health") to find out if indeed your robots.txt is as inaccessible, as you think it is. GL |
|||
|
|