Tagged Questions

2
votes
1answer
486 views

How to tell google to stop crawling my website via IP?

After a database server migration, Ive noticed that GoogleBot started getting errors when trying to crawl my site. The reason seems to be that its hitting my site via IP address (and due to my config ...