The default robots.txt of Blogspot is:
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://castbird-sourcing.blogspot.com/feeds/posts/default?orderby=UPDATED
But when I site:castbird-sourcing.blogspot.com the Google search show something like:
In order to show you the most relevant results, we have omitted some entries very similar to the 32 already displayed.
If you like, you can repeat the search with the omitted results included.
When I expand the result, I see something like:
castbird-sourcing.blogspot.com/search/label/gadget
A description for this result is not available because of this site's robots.txt – learn more.
My questions are:
- does this very similar to the 32 already displayed problem harm the SEO in general?
- shouldn't Googlebot have already ignored everything
/search
? Why do Google still indexing these pages? - How do I completely remove indexed
/search
link from the Google result?