I have links on my site which lead to internal pages that depend on first bringing data from an external API. This only takes time the first time they are pushed. Links to pages which exists in the DB, load a lot faster. I'm specify for search engines to only crawl the internal pages. This is what I thought of:
1. Creating a site map with the internal links
2. Adding this to every page on my site
<META NAME="ROBOTS" CONTENT="NOFOLLOW" />
Will this succeed? Does the site map over-ride the nofollow? Would you suggest a different direction?