I want crawlers to have access to
http://www.example.com but not
My robots.txt is as follows:
User-agent: * Allow: /$ Disallow: /
My site is in Google search results, but I am not coming up in Bing, Yahoo, etc. I have had the same robots.txt since last year, and I initially requested inclusion ~1 year ago, having also resubmitted the URL to those latter search engines several times since as well.
Is my robots.txt blocking those other crawlers? And if so, why not Google as well?