Hot answers tagged

35

Okay. Without knowing the sites in question, I will try and explain a bit of what is going on and I will provide just a few links. From: http://www.cradlecloud.com/ban-block-blackhatworth-com-spam-referrals/ I get the following domain names associated with the new method of referrer spam that people are seeing of late. BlackHatWorth.com Iskalko.ru Lomb.co ...


20

If you don't want to use the export-and-reinstall method suggested by danlefree, you might also find the Nuke extension useful. Once installed, visiting the special page Special:Nuke as an administrator gives you a form like this: There are also several built-in MediaWiki maintenance scripts that could be useful, including: cleanupSpam.php, which can ...


11

It sounds like the copyrighted content (the content that costs you money when someone visits that page) should be behind some kind of (free?) authentication/login? That would certainly help limit the number of visits to real visitors. You could perhaps have a non-copyrighted snippet or summary that can be indexed by all that linked to the full article in ...


10

They use a vulnerability in Google Analytics to make fake visits so the only way to stop them for now, and until Google fix it, is to make a filter in GA since that is the source of the problem. Blocking them in the .htaccess file is pointless since this kind of Spam never visits your site. Check this answers for more information about this spam https://...


9

Yes, different email obfuscation methods do work with varying degrees of success. But each has to be weighed with whether they affect the ability for your customers to communicate easily with you. I wouldn't want to be losing any business just because a user finds it annoying or time consuming to contact me. It would be a particularly persistent customer who ...


8

I used to work for a bulk mail sender and I created one of his mass mail sender. As you pointed, is not a option to use a mail marketing provider, the answer to you question is build your own. As I suppose, you will be sending email only from your domain, and not for any third party, it will be a lot more complicated. To build your own mail marketing you ...


8

The bot is looking for a site that automatically publishes their comments, using a "Black-List" method. Most Webmasters use the "White-List" method and only approve comments they have personally read. If the bot was able to post for example 100 links and Google's bot were to see those links it would give their URL a PR boost, even if you remove the comment ...


8

We did two things: Sign up with JMRP via https://postmaster.live.com/snds/JMRP.aspx Sign up with SNDS via http://postmaster.live.com/snds The JMRP application will go through a form and a document you need to sign. In our case it took about two days to get approved. Make sure that your SPF/DKIM/DMARC is setup correctly - we are using Port25 and their ...


7

Look into having a honey pot in your form, this will only work though if it's a generic robot, as the moment a custom script is written the honeypot can easily be bypassed. Also, if you're not keen on a CAPTCHA you could try Solve Media's alternative and earn a bit on the side at the same time, I think it was Ticketmaster who recently started using them as ...


7

The Spam is getting out of control. The list it's growing and it's time-consuming and not even efficient to add a filter for each of the spammers since most of them shows up for a few days and then disappear and a new one comes. There is a lot of misinformation, the most common mistake is recommending to use the .htaccess, this file blocks the access to the ...


7

The deep link to get whitelisted for Microsoft's email network is: http://go.microsoft.com/fwlink/?LinkID=614866&clcid This gives you the form "Sender Information for Outlook.com Delivery"


6

There is plenty solutions to expand short url: What is the best way in PHP or JS to expand shortened URLs like Bitly, Tinyurl to find the original URL? ExpandUrl (a java solution) Expand short URL – Simple PHP app for beginners expanding short url to original url using PHP and CURL Simple-URL-Expander (a javascript solution) When user submit a new post, ...


6

This is unlikely to be "visitors" (real people) but is likely to be automated software testing for vulnerabilities in the software run by your website. I've seen these types of requests for years. The most common for my servers is requests for WordPress administration pages and Microsoft FrontPage extensions. If you are not running the software, these ...


6

It's not normal that your site is outranking you, but can happen. Google has its own tool to report Scrapped content, you can check it here -> https://docs.google.com/forms/d/1Pw1KVOVRyr4a7ezj_6SHghnX1Y6bp1SOVmy60QjkF0Y/viewform I also advise you to make a DMCA complaint, as addresses copyright issues and can act faster. I had that experience in the past ...


6

If you look at https://developer.apple.com/library/prerelease/ios/documentation/General/Conceptual/AppSearch/UniversalLinks.html it seems that the URL in question is supposed to be a JSON file linking paths on your website, back to your iOS app (when such an association exists, naturally). I got some hits too which left and wondering the same as you. My ...


6

Turns out, the WordPress install was indeed compromised. I did a diff of my existing install vs a new WordPress install, and diff reported new file: # diff -qr wordpress_installed/ wordpress_new/ Only in wordpress_installed/wp-includes: class-wp-init.php I also found wp-config.php had been edited to include this @include_once(ABSPATH . 'wp-includes/class-...


5

How odd ... I can "answer" but I can't "comment". Anyway... Are you sure the user is doing it on purpose? You don't mention what e-mail system you are using, but (for example) in GMail, the two buttons are right next to each other; the "delete" is a trash can and the "spam" is a stop sign. In Yahoo mail, the "delete" is a trash can and the "spam" is an X....


5

The header X-CNFS-Analysis is added to emails processed by Cloudmark Authority, an email filtering engine, and appliances which use this engine such as Cloudmark Security Platform. In newer versions, it has been renamed to X-Authority-Analysis. In the case of Rackspace, they use Cloudmark Server Edition, a plugin for Microsoft Exchange, to provide filtering ...


5

You can exclude them by creating a filter. You need to find something specific enough so you don't accidentally block good visitors and it is tedious as you have to manually add each spammer but this will do the trick.


5

Recently there has been a spate of Google Analytics spammers. They typically: Send requests directly to Google's collector script without ever hitting your website. Put advertisements for their website into referrers or other places where the data shows up in your reporting Customize their requests only with your Analytics Id (but not with your domain ...


5

Since this does appear to be the real Googlebot, the recommended way to block access/crawling is to use /robots.txt: User-agent: googlebot Disallow: /blocked.php However, if you still want to block this IP using .htaccess then you can do something like the following, near the top of your root .htaccess file: RewriteEngine On RewriteCond %{REMOTE_ADDR} =66....


4

I have a lot of experience stopping spam. In fact, I used to speak with GFI and shared some of my filter techniques with them. You can stop spam with near 100% effectiveness with a few simple steps. This does not negate the need for an anti-spam filter or mean that you will never get spam, however, just a couple of things will almost stop spam cold. It is ...


4

I have used Google's tool to report paid links that I've found. None of the ones that I reported were removed immediately, but many did get removed with the Penguin update. There was a recent thread on WebmasterWorld about this: Is Reporting Webspam to Google as Ineffective as a Sugar Pill? Several people reported in that they don't think it is effective ...


4

Google has algorithms that detects paid links as well links that are not-relevant, Generally paid links from a lot of sites are rendered useless in any case because they don't come from relevant niches which won't help other than boosting Google Page Rank. Sadly looking at your links they do look like paid sponsors and they look relevant so we can assume ...


4

"Bad" traffic will ignore your robots and constantly spider you. It will always be changing ip addresses and agent combinations and that is a fact of life. You may be able to look into "honeypot" type solutions to stop bad repeat traffic that ignores your robots but it can become impractical to manage blocking it yourself unless you love the game "wack-a-...


4

Several bots don't follow robots.txt declarations. You need to block the user-agent with your server and return 403 Forbidden HTTP response. On IIS, you can block a user-agent with your server. You can follow this procedure on moz.com: http://moz.com/ugc/blocking-bots-based-on-useragent I didn't explain the procedure here because it would be too long.


4

The Grapeshot crawler should honor your robots.txt, as it’s documented on their site: With a robots.txt files you may block the Grapeshot Crawler from parts or all of your site […] Maybe it’s not the real Grapeshot crawler visiting your site? You could check the IP address: The Grapeshot crawler can be identified by requests coming from Grapeshot ...


4

The bots are probably harmless. But I like to think that I'm starring in a Tom Clancy novel and it's a sleeper cell waiting to unleash a tidal wave of spam that could ultimately compromise national security. So I recommend deleting them on a routine basis. ;) When a user signs up, determine what country they're from. I find that MaxMind's GeoIP web service ...


4

Blocking by referrer won't help: Googlebot doesn't send a referrer header when it crawls, so it will never see your block. Here is what Google's John Mueller (who works on Webmaster Tools and Sitemaps) has to say about 404 errors that appear in Webmaster tools: HELP! MY SITE HAS 939 CRAWL ERRORS!!1 I see this kind of question several times a week; ...


Only top voted, non community-wiki answers of a minimum length are eligible