I use robots.txt to block all robots.txt compliant bots from a directory like this:
User-agent: * Disallow: /sub/*
How can I override this so to allow Mediapartners-Google (AdSense) to /sub/?
Webmasters Stack Exchange is a question and answer site for webmasters. It only takes a minute to sign up.Sign up to join this community