I have a webpage on my university's server, which means I cannot access the root directory and change files there.
Is there some other way to give access to robots to my page?
Thanks.
-
2Do you specifically have evidence they're not accessing the page? Overall, spiders will crawl anything they can get at by default, with robots.txt generally used to limit that behavior, not the other way around. (It's the Robots Exclusion Protocol) While what you're asking is possible, it's probably unnecessary, unless the university has a robots file set up blocking them, in which case you might want to inquire with them why that is. – Su' May 7 '11 at 19:08
-
@Su' - Yes, I know for sure they have no access. – Pandora May 7 '11 at 19:19
-
@Pandora, how do you know? If you can see it in a browser then they should be able to see it, too. – John Conde♦ May 7 '11 at 19:49
-
@John Conde Incorrect. IE, Firefox, and other browsers are not robots; they do not check or obey robots.txt. Whereas a bot like GoogleBot will check robots.txt, and obey it if it denies access. So it's entirely possible that Pandora can access the site's pages, but bots cannot. – Will Martin May 7 '11 at 22:41
-
@will if there is no robots.txt then they can. That seems to be the case here. – John Conde♦ May 8 '11 at 1:14
you can set the meta tag:
<meta name="robots" content="all">
or you can go to Google AddUrl and add your URL to Google. But when you have no good content on your site you don't get so much site so the index. In the last time its very important to place sites to google in a good position.
Before you should read some things about SEO optimizing.
