I am working on a php site that uses Code Igniter framework and has the following folder structure on the server.
The bulleted list of items are subfolders under public_html.
The application folder contains the code consisting of views and controllers.
My question is,
should googlebot be able to crawl folders other than application?
should I Disallow all folders other than application so that no search engine bot gets to crawl other folders?