Questions tagged [yandex]

Yandex (Russian: Яндекс) is the largest search engine in Russia.

Filter by
Sorted by
Tagged with
1
vote
1answer
61 views

Yandex ignores Crawl-delay?

I try to get the Yandex Bot under control and I'm close to block it. After 2 months of robots.txt adjustments, it still keeps hammering my server from multiple IPs. User-Agent: * Crawl-delay: 4 ...
2
votes
2answers
91 views

Not use Google Analytics could penalize page rank in Google Search?

I am using Yandex Metrika as tool for analytics. However I am concerned about the impacts in terms of SEO. For example. How Google knows how much time the users stay in this website? I mean, things ...
1
vote
2answers
924 views

Robots.txt isn't preventing my site from being crawled

I'm having problem with robots.txt. I put the robots.txt file in the website main directory (and also in /var/www/html - to make it work on all the server) but robots still keep crawling my websites. ...
3
votes
1answer
84 views

Clean URLs at multilingual single-page site

I'd like to get rid of multilingual stuff in URLs, i.e. to get site.com/page instead of en.site.com/page, site.com/en/page, and site.com/page?lang=en. The motivation is: humans don't need the stuff. ...
0
votes
1answer
6k views

How block only Yandex bot

Can you show me how will look robots.txt when I block only yandex bot, allow Google bot and block Yandex bot.
5
votes
1answer
861 views

Block Yandex crawler

Our site has been behaving very strangely for the last few days, lots of time outs etc. Finally think I found the cause, the Yandex bot is crawling around 10,000 pages an hour! I need to stop it ...
5
votes
1answer
1k views

Is there any way to extract referrer and search term from a Yandex redirect URL?

I've gotten some visits to pages that are supposed to be completely hidden from everyone via Yandex and I'd love to find out: what search term led them to it the referring page on my site The ...
2
votes
2answers
956 views

Why does Google Analytics miss Yandex clicks?

Google Analytics seems to miss most of the clicks from Yandex. Is there anything to make them show up in Google Analytics?
2
votes
2answers
66 views

Might category noindex prevent indexing of other pages on Yandex?

On my website I put noindex on my category pages but not the pages under it. Even though two weeks passed, the only indexed page is my home page which is not under any category. When I look at ...
3
votes
1answer
123 views

Restrict google from indexingcertain content on my page

I have an ecommerce shop with ~10 000 items. I wrote parser to load this items to my website from another website. But items description is not unique. So I am afraid that google can bun my website. ...
1
vote
1answer
133 views

The Yandex index robot is redirected when requesting this site so the robots.txt file will not be used. What's the fix?

We have a website: www.example.com which redirects to https://www.example.com. Therefore when you type www.example.com/robots.txt you are redirected to https://www.example.com/robots.txt. Another ...
2
votes
1answer
134 views

Yandex mobile services robot - is it really a mobile user agent?

As you can tell, I want my website indexed properly in as many search engines as possible. I'm looking at Yandex and using its "Server Response Check" tool which is similar to "Fetch as google" tool ...
3
votes
1answer
178 views

Is allowing crawling from Baidu and Yandex valuable for English sites?

In the early days, I understand that Baidu and Yandex were both known for excessive crawling with very little value for English sites, but those days seem to be gone now. In those early days, I ...
2
votes
2answers
64 views

Prove to Yahoo and Bing that you are the original author

Yandex (the main Russian search engine) has a form where you can submit text here: https://help.yandex.ru/webmaster/authored-texts/owners.xml If the text does not exist already, then yandex will ...
1
vote
1answer
59 views

When advertising on Yandex, why does my ad get shown for broad queries and why do so many users click?

I'm using Yandex Direct - it is Russian contextual advertising system. We are creating and promoting sites, and started contextual advertising campaign. There were a lot of keywords like "create ...
2
votes
2answers
908 views

Can't add HTTPS site to Yandex Webmaster Tools

I've recently changed a website to run only on HTTPS. HTTP connections are 301 redirected to HTTPS and a HSTS header (Strict-Transport-Security: max-age=31536000) has been added. I've added the HTTPS ...
2
votes
3answers
556 views

Yandex.Metrica: can I redirect from /favicon.ico to the 1×1 gif counter?

I have a very simple site, with no graphics, and I don't want to spoil it with a huge JavaScript monitoring loop. I don't have a favicon.ico, and I always see 404 requests from browsers requesting ...
3
votes
2answers
142 views

Yandex frequently replaces page names with ampersands

The Yandex spider is a frequent visitor to one of the sites I manage. On occasion it replaces the page name with two ampersands and a space. So if the page is: /mypage.aspx?param=value then it ...
3
votes
1answer
2k views

Preventing high bandwidth usage from Yandex

Although I put a row for Yandex into my robots.txt file, sometimes Yandex indexes my website aggressively. So I hard coded a part and check for user agent, and serve cached file if user agent is like ...