1
vote
1answer
285 views

Sitemap vs nofollow

I have a sitemap on my site, which includes all users from the site. On the user profile page, tho, I don't want google to index all users, only those with more than 10 posts, so I've added a meta ...
0
votes
1answer
95 views

Specifying crawlers to not crawl Links which are dependent on external API's

I have links on my site which lead to internal pages that depend on first bringing data from an external API. This only takes time the first time they are pushed. Links to pages which exists in the ...