I have a number of files in my site which are not intended for independent viewing, but rather to be AJAXed into content within the site. They obviously don't meet HTML standards (no body, head, etc.) as independent entities. I would like to prevent search engines from indexing these pages, but do not have access to
/robots.txt (which would be much more ideal).
My question is, could I include the following at the top of these partial HTML files and get the desired results?
<meta name="robots" content="noindex, noarchive">
I guess there are two parts to this question.
- Will this cause any rendering issues in any browsers?
- Will search engines (at least Google & Bing) interpret this as intended?