We have problem with declining CTR caused by unwanted video snippet on SERP. Therefore we have taken measure to block the Googlebot from crawling our video file.

User-Agent: Googlebot
Disallow: /*.mp4$

However, still many of our pages got this video snippet.

  1. Does Googlebot-video need to be blocked as well?

  2. Why is it mentioned here Googlebot and Googlebot-video for user agent tokens for Googlebot Video (https://support.google.com/webmasters/answer/1061943?hl=en)? Does it mean both can be used interchangeably for blocking any video result? (Blocking Googlebot means also removing result from video search?)

  • Are there any crawlers you want downloading videos? Maybe use User-Agent: * – Stephen Ostermiller Jun 20 '18 at 9:49
  • might be a little bit overkill. Just want to know what exactly does Googlebot and Googlebot-video crawl for, so I can apply appropriate directive. thanks for the suggestion. – GidSut Jun 20 '18 at 10:27
  • 1) Do you mean their video rich result? 2) Do you provide the Schema.org structured data? – unor Jun 20 '18 at 10:39
  • 1. Yes. like this 2. No. as we don't want to give more video "signal" to Google – GidSut Jun 20 '18 at 12:18
  • Why not check your server logs to see which bots access the videos. – Tony McCreath Jun 20 '18 at 12:37

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.