I have a hidden page that verifies internal payments from PayPal. The page has the following in its HTTP headers:
X-Robots-Tag: noindex, nofollow
But once in a while I see this in the page logs:
HOST: 208-115-111-71-reverse.wowrack.com USER_AGENT: Mozilla/5.0 (compatible; Ezooms/1.0; email@example.com)
What is that
wowrack.com? And how do I stop it crawling my pages?