|
Imagine i have a page on my website that i don't want to be followed by robots. So i put a "rel='nofollow'" on every link to that page. Now imagine i have a form on another page which action is a link to that page. I heard that SEs try to post form. If it is true, they will reach a page that i don't want to be indexed. Am i falling into paranoia ? Do SEs really try to post forms ? Thanks in advance Guillaume |
|||
|
|
|
Yes, they will try to post the form. Anyway, the approach you're using could potentially have problems if someone else links to the page. If you don't want a page to be crawled by a responsible bot (like Google/Bing etc) then you should use the robots.txt file to disallow them from crawling it. If you don't have access to robots.txt you can do a similar thing with the robots meta tag. Adding the following to the head of the page you don't want indexed should work: |
|||
|
|
