We have a Magento based store.
Images are resized and served cached dynamically. When the image cache in Magento is cleared, there are generated new paths and files.
And I get 404 errors for them in Webmaster tools / Search Console.
After Googling and looking at examples, I settled on this as a good solution. (http://inchoo.net/ecommerce/magento-robots-txt-best-practices-google-image-crawler/)
I added this to robots.txt:
User-agent: Googlebot-Image Disallow: User-agent: * Disallow: /media/
The problem now is:
We get a whole lot of "Blocked resources" and "Mobile usability" problems instead.
Google says that it could result in suboptimal rankings: https://developers.google.com/webmasters/mobile-sites/mobile-seo/common-mistakes/blocked-resources?hl=en
So how does one handle this so Google is happy? What would you recommend?