Tagged Questions
1
vote
1answer
69 views
Search and Tags for robots.txt
After setting up a blog at blogspot.com I added the site to my webmasters tools of google.
I noticed an error: "Restricted by robots.txt" and looked a little into the matter. I found in the ...
3
votes
3answers
307 views
PageRank: will links pointing to pages protected by robots.txt still count?
If every single link to a given website www.example.com points to a page in a particular subdirectory (i.e. www.example.com/user/[something]), but that directory is off limits as per robots.txt, i.e.
...
