Hot answers tagged

8

I have just successfully blocked the Chinese searchbot Baiduspider from accessing any content on my site. I made the decision to do so because of the following reasons. Reasons for deciding to block Approximately every 20th request to my server was from a baidu bot. This is unpolite behavior. Baidubot accounts for 5% of my sites bandwidth usage. I make a ...


6

http://zhanzhang.baidu.com/sitemap/index is the (sparse) documentation about sitemaps for Baidu. It only describes that it may help to submit your sitemap, and it shows a screenshot of their webmaster tool, listing several sitemaps and their status. However, it seems that they intend this feature only for "high quality" sites, on invitation basis. Here is ...


3

Whoa boy, this approach and Baidu won't play nice at all.... 1) Check to see if the domain is blocked by the "Great Firewall" with https://en.greatfire.org/analyzer. If so, sorry, there's something that's "objectionable" and you likely will get your site blocked again no matter what you do to try and get around the censors. But if not: 2) See if the domain ...


3

Just decided to block Baidu as the amount of traffic it was giving us was too negligible for their aggressive scanning. In addition, they now run an agent that impersonates a browser and launches JavaScript code (such as Google Analytics) and messed up our statistics. The nice version is updating your robots.txt with the following User-agent: Baiduspider ...


3

Baidu has a Webmaster Tools application that is written in Chinese. But all is not lost. Here is a tutorial: http://www.webnots.com/baidu-webmaster-tools.html The tutorial is written in English and translates the options for you. I am not sure how up to date this is, but it does look complete otherwise and may be useful. I do not see that Baidu reads the ...


2

It seems you are not doing anything wrong. I can asure you, that is not the baidu spider. The baidu spider would have a footprint like: "GET /someurl HTTP/1.1" 200 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)" The log indicates a HTTP spammer. A lookup on the given IP: https://cleantalk.org/blacklists/118.244....


2

Since I made that comment, I should probably explain myself a little. Blocking a search engine does not jeopardize your future ranking on that search engine. However, it's still unwise to block a search engine simply because you don't currently receive any search traffic from them. The reason being that, just because you don't currently receive much traffic ...


2

Wordpress solution (not the best but helps) Same problem with Biadu spider, that aggressive that my box ranked over 35 in my console using top. Obviously that even a fast computer cannot handle effectively outside requests running at 35.... I traced the number of IP's (from that University building ????) to be several hundreds, with mainly two useragents) ...


2

I can't tell much about Baidu's ranking algorithms. But I've been living in China for quite some time already. During all these years, I did not see much of .中国 domains in use. Neither did I see them within the first ranks of Baidu on either search conducted so far. I'd suggest going for .cn, if your content is about to be in simplified Chinese, and .com if ...


2

Better focus on building one quality website with all content in it than having multiple domains. I once worked with a company that build multiple websites for the same product, one website for the product, one as a blog with dozen to nearly hundred of articles related to our product and link to the main site, and some other site as "landing page". Trust ...


2

Are both sets of text content (in an HTML document) equally visible to search engines Absolutely yes: both variants are fully equal. All search engines understand unicode (your second example), the encoded HTML entities from the first example are not a problem too. The entity encoding is nothing other as another encoding like, win-8859-1, utf-8 or win-1251....


2

I've had the same problem while launching a site for a client there. When submitting any site to Baidu, it expects a fully chinese site hosted in China. If you can't provide a fully translated Mandarin version for your Wordpress site, try adding this to your html: <META HTTP-EQUIV="Content-Language" CONTENT="ZH"> Place the above meta tag on atleast ...


1

I haven't specifically dealt with this problem so I'm "thinking out loud" as I write this: I've never been especially concerned with Baidu but my understanding is that it is a Chinese social media site so: Do they allow users to create subdomains (like Google Sites, Blogger, WordPress.com etc)? Do they allow users to create maps listings? Is there a ...


1

Actually there is a trick to create Baidu Account. Connect to Hong Kong VPN https://login.bce.baidu.com/?lang=en use this link to create Baidu account without Chinese mobile number I found this to be 100% working.


1

PBN's have proved to be working (only if done correctly) with Blackhat niches like Game Hacks and Movie downloads. But as Google got smarter, it is very difficult to hide all the footprints that Google might be tracking. PBN strategy is as simple as this: Purchase multiple domains (with unique owner info) Purchase hosting for multiple domains from ...


1

In addition to Stephen's comment, Baidu is little bit insecure. As SEO concerned, just do everything as you are doing with google and it'll all be fine. Amount of traffic that Baidu and Bing provide versus amount of traffic that google provides is best explained in this picture below. For December 2012, the search landscape was like this: Google: 114.7 ...


1

Indeed, according to this, Baidoo doesn't read Javascripts, Ajax etc. But the approach in example code by John Mueller lets address every page through own urls and, beside of it, through the pagination links on the bottom of every page and rel="prev/next" in the head. So, the site using infinite scrolling/pagination as in example will look for Baidoo as a ...


1

The most effective way to do this is to use a robots.txt file with Disallow: / as the only directive and place it in the web root for the images domain. When this is done search engines won't crawl the images. The reason why you got the error from Google was only because it was a computer based evaluation that deemed that the images may have been needed to ...


1

Yes, the more search engines you allow to your site, the higher impression count you'll likely get with adsense. Now if the websites main focus is on images and the english text mostly describes those images, then the images speak for themselves for the international users, so the remote search engines can definitely raise your impression count there. It's ...


1

The answer is yes, you paste the Baidu conversion snippet onto page 2 for both versions because Baidu needs to know where the conversion comes from in order to properly notify the system. I've never used the Baidu tracking, but this is how normal tracking system work.


1

Baidu spider also does not properly obey robots.txt in some cases. They seem to have a history of doing things their own (wrong) way. Unless you have a Chinese website that gets a significant amount of traffic from the Baidu search engine, why would you keep old server up just to make the Baidu spider happy?


1

Use .htaccess with RewriteEngine On RewriteCond %{HTTP_USER_AGENT} ^.*MJ12bot [NC,OR] RewriteCond %{HTTP_USER_AGENT} ^.*Baidu [NC] RewriteRule .* - [L,F] The "RewriteEngine On" allows you that the following lines are parsed correctly. The HTTP_USER_AGENT is the line where the spiders are identifying themselves. The condition is true if the line contains "...


Only top voted, non community-wiki answers of a minimum length are eligible