The tag has no wiki summary.

learn more… | top users | synonyms

0
votes
1answer
321 views

Google Webmaster Tools “increase in not found errors” is wrong

I got a ton of not found errors in Google Webmaster Tools, but the weird thing is, all of the pages ARE found. There is absolutely no error in the URLs they list that supposedly don't exist. Why is ...
1
vote
0answers
42 views

How to Keep “Good” Bots That Ignore Robots & Nofollow From Getting Into Honeypots?

We have a self generating honeypot that is designed to fill crawlers with junk data (among other things). Its protected with the right "treaties" and headers so 99% of good bots stay away. Today ...