In failing to check my robots.txt on a community site, it had:
User-agent: *
Disallow: /
I only clued into this because of a message in my AdSense account saying that five URL's couldn't be crawled. Only five, out of about 600 that are currently indexed.
Even though I mistakenly had Disallow: /
, why were these pages still indexed and getting traffic?