1

I need google don't crawl my adblock.php URL, after i added this URL in my robot.txt file like,

Disallow: /adblock.php

The google shows report like,

enter image description here

I had added adblock.php to robots.txt because Google was indexing it instead of the home page URL.

closed as unclear what you're asking by Stephen Ostermiller Sep 18 '17 at 10:07

Please clarify your specific problem or add additional details to highlight exactly what you need. As it's currently written, it’s hard to tell exactly what you're asking. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.

  • You have to have it linked somewhere or possibly included in a sitemap. Do not do this. I do not know what the adblock.php file is exactly. Google is seeing your adblock.php file as a valid page which should not be the case unless it is one. Cheers!! – closetnoc Sep 11 '17 at 16:42
  • If you go to your site without a file name, such as example.com, do you see your home page? – closetnoc Sep 11 '17 at 17:13
  • What content is available at adblock.php? Is it duplicate of the home page? What is the purpose of that script? – Stephen Ostermiller Sep 15 '17 at 15:14
  • Please edit this question to add the requested details. – Stephen Ostermiller Sep 18 '17 at 10:08