7 votes

Deny access to Archive.is

Okay. This is a new one (to me at least) and quite interesting so far. I will not get into the weeds on this. When I wrote this, I was working on little or no sleep. I missed a few things which @unor ...
user avatar
  • 32.5k
4 votes
Accepted

Is there a way to have Google index a page but not cache it?

You can add a "Noarchive" Directive to prevent Google from caching specific web pages. <meta name="robots" content="noarchive"> or for just Google: <meta name=&...
user avatar
  • 4,678
3 votes

Deny access to Archive.is

robots.txt Archive.is does not use a bot that autonomously crawls pages (e.g., by following hyperlinks), so robots.txt does not apply, because it’s always a user that gives the command to archive a ...
user avatar
  • 21.5k
1 vote

Deny access to Archive.is

As we can see, archive.is is using DNS anycasting. If you use different nameservers (e.g. from https://www.lifewire.com/free-and-public-dns-servers-2626062) you currently (2018-09-10) get different ...
user avatar
1 vote

Deny access to Archive.is

To block the disgusting stealing practices of archive.is (ignoring robots.txt, overriding link canonical, fake user agent, no way to perform a site-wide removal), I want to add the following to the ...
user avatar
  • 111
1 vote

How long does it take to re-index the website via noarchive tag?

Firstly there is no need to use the noarchive robots tag in your situation. You state it is to remove all of your old content from the Google cache and then you remove it to have the cache save your ...
user avatar

Only top scored, non community-wiki answers of a minimum length are eligible