1
vote
1answer
43 views

Why would I use a robots.txt file? [duplicate]

From what I understand after reading Google's Controlling Crawling and Indexing: The purpose of robots.txt file is to disallow crawling of some URLs, but those can still be indexed (and appear in ...
2
votes
1answer
65 views

Avoiding crawl time for noindex pages

I have pages with noindex in robots meta tag (specifically inner site search results pages). Because my site has many pages and Google hasn't crawled them all and I'm trying to help his crawler focus ...
4
votes
1answer
227 views

Using rel=canonical and noindex in a 1-n partners environment

We sell complete sites including the domains to several partners that create content that is shown together at the main site. What we want to achieve is that the main site copy is the original but the ...
1
vote
2answers
71 views

SEO: How to stop certain web-pages from “having importance” [duplicate]

Possible Duplicate: SEO - Reducing significance of irrelevant kewords. I wrote "having importance" since I do not really know the right way to say this. I have certain pages in my site ...