This is the contents of my robots.txt file:

User-agent: *
Disallow: /static/*
Disallow: /templates/*
Disallow: /translations/*
Sitemap: https://xx.xxx.com/sitemap.xml

However I don't know why I am getting this error in Google Search Console:

Is robots.txt blocking important pages? Some important page is blocked by robots.txt.

Maybe due the static folder? So the question is, should I remove static folder from the robots?

https://example.com/static/css/A.landing.css.pagespeed.cf.ScWDdlA8KO.css Style Sheet Blocked High robots.txt Tester

  • You should state what is in your /static directory. We have to assume that it's your JS and CSS files, and possibly images?? – MrWhite Feb 17 '17 at 19:49

You shouldn't block Googlebot from accessing your CSS.

  • Any official documentation about this? – anvd Feb 17 '17 at 10:30
  • @anvd There are so many sources for this, it's plastered everywhere across Google's documentation. I've added two to my answer. – grg Feb 17 '17 at 10:33
  • That's like a good answer. One line answer always make doubt to newbie :) – Goyllo Feb 17 '17 at 10:35

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.