Return to Answer

OK, so I did a little more research and found the answer at http://stackoverflow.com/a/30362942/1983389

OK, so I did a little more research and found the answer at https://stackoverflow.com/a/30362942/1983389

It appears the most correct and most supported solution across all web crawlers is something like the following although allowing access to *.css and *.js files in some folders e.g. /logs and /installation makes no sense:

User-agent: *
Allow: /administrator/*.css
Allow: /administrator/*.js
Disallow: /administrator/
Allow: /bin/*.css
Allow: /bin/*.js
Disallow: /bin/
Allow: /cache/*.css
Allow: /cache/*.js
Disallow: /cache/
Allow: /cli/*.css
Allow: /cli/*.js
Disallow: /cli/
Allow: /components/*.css
Allow: /components/*.js
Disallow: /components/
Allow: /includes/*.css
Allow: /includes/*.js
Disallow: /includes/
Allow: /installation/*.css
Allow: /installation/*.js
Disallow: /installation/
Allow: /language/*.css
Allow: /language/*.js
Disallow: /language/
Allow: /layouts/*.css
Allow: /layouts/*.js
Disallow: /layouts/
Allow: /libraries/*.css
Allow: /libraries/*.js
Disallow: /libraries/
Allow: /logs/*.css
Allow: /logs/*.js
Disallow: /logs/
Allow: /modules/*.css
Allow: /modules/*.js
Disallow: /modules/
Allow: /plugins/*.css
Allow: /plugins/*.js
Disallow: /plugins/
Allow: /tmp/*.css
Allow: /tmp/*.js
Disallow: /tmp/

It appears the most correct and most supported solution across all web crawlers is something like the following (allowing access to *.css and *.js files in the /bin, /cache, /installation, /language, /logs, and /tmp folders and possibly some of the other folders makes little sense):

User-agent: *
Allow: /administrator/*.css
Allow: /administrator/*.js
Disallow: /administrator/
Disallow: /bin/
Disallow: /cache/
Allow: /cli/*.css
Allow: /cli/*.js
Disallow: /cli/
Allow: /components/*.css
Allow: /components/*.js
Disallow: /components/
Allow: /includes/*.css
Allow: /includes/*.js
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Allow: /layouts/*.css
Allow: /layouts/*.js
Disallow: /layouts/
Allow: /libraries/*.css
Allow: /libraries/*.js
Disallow: /libraries/
Disallow: /logs/
Allow: /modules/*.css
Allow: /modules/*.js
Disallow: /modules/
Allow: /plugins/*.css
Allow: /plugins/*.js
Disallow: /plugins/
Disallow: /tmp/

EDIT 2 - BEST SOLUTION:

OK, so I did a little more research and found the answer at http://stackoverflow.com/a/30362942/1983389

It appears the most correct and most supported solution across all web crawlers is something like the following although allowing access to *.css and *.js files in some folders e.g. /logs and /installation makes no sense:

User-agent: *
Allow: /administrator/*.css
Allow: /administrator/*.js
Disallow: /administrator/
Allow: /bin/*.css
Allow: /bin/*.js
Disallow: /bin/
Allow: /cache/*.css
Allow: /cache/*.js
Disallow: /cache/
Allow: /cli/*.css
Allow: /cli/*.js
Disallow: /cli/
Allow: /components/*.css
Allow: /components/*.js
Disallow: /components/
Allow: /includes/*.css
Allow: /includes/*.js
Disallow: /includes/
Allow: /installation/*.css
Allow: /installation/*.js
Disallow: /installation/
Allow: /language/*.css
Allow: /language/*.js
Disallow: /language/
Allow: /layouts/*.css
Allow: /layouts/*.js
Disallow: /layouts/
Allow: /libraries/*.css
Allow: /libraries/*.js
Disallow: /libraries/
Allow: /logs/*.css
Allow: /logs/*.js
Disallow: /logs/
Allow: /modules/*.css
Allow: /modules/*.js
Disallow: /modules/
Allow: /plugins/*.css
Allow: /plugins/*.js
Disallow: /plugins/
Allow: /tmp/*.css
Allow: /tmp/*.js
Disallow: /tmp/