User-agent: *
Allow: /ads.txt
Disallow: /ads

Disallow: /search

User-agent: Mediapartners-Google

Allow: /

Sitemap: https://example.com/atom.xml?redirect=false&start-index=1&max-results=500
Sitemap: https://example.com/sitemap.xml

Sitemap: https://example.com/atom.xml?redirect=false&start-index=501&max-results=1000

Sitemap: https://example.com/atom.xml?redirect=false&start-index=1001&max-results=1500
  • 2
    What are your goals? Do you want to have your entire site indexed except search and ads? – Stephen Ostermiller Jun 29 at 8:55

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.