New answers tagged web-crawlers
1
vote
Accepted
How to protect from spam when the legislation forces you to display the email address?
A little bit of obfuscation stymies all the bots. I've been using a combination of HTML entities, JavaScript, math, and plain text to display my email address in my page for years and still get no ...
Top 50 recent answers are included
Related Tags
web-crawlers × 903seo × 317
googlebot × 210
robots.txt × 197
google × 109
google-search-console × 107
search-engine-indexing × 76
search-engines × 52
google-search × 44
sitemap × 34
javascript × 31
404 × 31
wordpress × 26
htaccess × 25
google-index × 25
crawl-rate × 24
user-agent × 23
url × 22
ajax × 22
bing × 22
noindex × 21
links × 20
security × 20
crawl-errors × 20
google-adsense × 16