I have a Magento site and a WordPress site is used in a directory for the blog. My blog keeps getting hit as not mobile friendly and the reason I believe is that there are certain resources blocked in robots.txt. The part of my robots.txt that is giving me problems is this:
# Do not index session ID Disallow: /*?SID= Disallow: /*? Disallow: /*.php$
This is from the standard Magento template. One of the blocked resource URL is:
I think this line
Disallow: /*? is blocking that example URL. I would prefer not to remove that line. Is there a way to allow everything in the wp-content directory while still blocking the Magento URLs with that rule?