All web resources crawled by Google bots and recorded in Google databases.

learn more… | top users | synonyms

23
votes
6answers
2k views

Why isn't my website in Google search results?

I've made a website one month ago and it still isn't indexed by Google. I haven't change any setting in the robots.txt file. I've tried to search for site:websitename.com but I still can't see it, ...
11
votes
5answers
4k views

Does Google cache robots.txt?

I added a robots.txt file to one of my sites a week ago, which should have prevented googlebot from attempting to fetch certain URLs. However, this weekend I can see Googlebot loading those exact ...