7

Okay. This is a new one (to me at least) and quite interesting so far. I will not get into the weeds on this. When I wrote this, I was working on little or no sleep. I missed a few things which @unor has kindly pointed out and so I must temper my answer and give credit where credit is due. Thank you @unor! Archive.is is registered to Denis Petrov who is ...


4

You can add a "Noarchive" Directive to prevent Google from caching specific web pages. <meta name="robots" content="noarchive"> or for just Google: <meta name="googlebot" content="noarchive"> There is no penalty for doing this. Here are some typical scenarios to use Noarchive: Advertising you ...


3

robots.txt Archive.is does not use a bot that autonomously crawls pages (e.g., by following hyperlinks), so robots.txt does not apply, because it’s always a user that gives the command to archive a certain page. For the same reason, services like Google’s Feedfetcher (Why isn't Feedfetcher obeying my robots.txt file?) and W3C’s Validator (details) don’t ...


1

As we can see, archive.is is using DNS anycasting. If you use different nameservers (e.g. from https://www.lifewire.com/free-and-public-dns-servers-2626062) you currently (2018-09-10) get different ip addresses for "archive.is" (dig @NAMESERVER archive.is A) 104.27.170.40 104.27.171.40 154.59.112.68 185.219.42.148 46.105.75.102 46.17.42.43 46.182.19.43 46....


1

To block the disgusting stealing practices of archive.is (ignoring robots.txt, overriding link canonical, fake user agent, no way to perform a site-wide removal), I want to add the following to the solutions above. Find their IP-addresses To find their ip-addresses, submit a url to them that is under your control so that you can monitor your web server ...


1

Firstly there is no need to use the noarchive robots tag in your situation. You state it is to remove all of your old content from the Google cache and then you remove it to have the cache save your new content. It doesn't exactly work this way as each time Google detects a new version of your page the cached copy stored with Google will be updated to ...


Only top voted, non community-wiki answers of a minimum length are eligible