In general, I want my site to be indexed, but there are certain files I don't wish to be searchable from Google, Yahoo, etc... I know you can block your site from being indexed using a robots file, but what if I only want certain files to not be indexed? | |||
|
feedback
|
This question covers exactly the same ground as earlier questions on this topic; its answers may be merged with another identical question. See the FAQ for guidance on how to improve it.
|
For this you can use robots.txt too. Then you would write several disallow statements. Here are some examples: For more information see the specification of the robots file. But be aware that not every spider respects this file. So maybe you need other methods like e.g. the nofollow meta tag if you really want to be sure. | |||
|
feedback
|
