Tag Info

New answers tagged

1

If you're using Apache web-server you could use an .htaccess configuration to white-list by User Agent and prevent genuine bots from reaching your 'tarpit': RewriteEngine On RewriteCond %{HTTP_USER_AGENT} SEMrush [NC] RewriteRule .* - [F,L]


0

nofollow needs to be used only: when you don't trust the links (in your case links to Twitter, Facebook, Google+, etc.) for paid links for crawl prioritization You are not in these 3 cases, that's why if I were you I wouldn't add nofollow to these links. More info about nofollow on this Google's support page.


5

Search engines crawlers follow the most restrictive rule. If you use nofollow in your meta tag, no link will be followed. If you use follow in your meta tag, all links will be followed except those with rel="nofollow". So answer to your question is no, meta tag with follow doesn't override individual rel="nofollow". ...



Top 50 recent answers are included