Skip to main content
2 of 6
added 69 characters in body
undo
  • 111
  • 7

How to stop Google from crawling pages through my proxy?

I have a proxy at http://rahul2001.com/proxy/

I site can be 'proxied' by like this: http://rahul2001.com/proxy/proxy.php/http://site-to-be-proxied.com/

The problem is that Google seems to be crawling pages through my proxy :/

[![uh oh..][1]][1]

I do NOT link a proxied version of Yahoo food or Google Careers or Google Search Hindi Help, but these still turn up in the search results...

PROBLEMS:

-I DO NOT want to block my website/proxy from search engines.

-I DO NOT want Google to use up my bandwidth by crawling useless sites.

-I DO NOT want to use captcha since a few of my apps use this proxy.

-I DO NOT want Google to spoil the search results of my website in this manner.

What do I do??

ALSO, why the hell is google entering random URLs into the form?? [1]: https://i.sstatic.net/l2Hdn.png

undo
  • 111
  • 7