I see that many popular sites have pages indexed in Google, but when I try to access Google's cache the page isn't there.
How can I go about doing the same thing with my site? I read that you have to make specific settings to the robots.txt
file. What do I need to add in that file?
If robots.txt
isn't possible, is there another way to disable Google's cache?