Timeline for Indexing pages from own search engine
Current License: CC BY-SA 3.0
7 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jul 13, 2011 at 19:36 | comment | added | methode | FYI, John, letting search engines to index search result pages is generally against their webmaster guidelines. Google's Webmaster Guidelines [1] for instance says: "Use robots.txt to prevent crawling of search results pages or other auto-generated pages that don't add much value for users coming from search engines." [1] -- google.com/support/webmasters/bin/answer.py?answer=35769#2 | |
| Jul 13, 2011 at 14:34 | vote | accept | Jeroen | ||
| Jul 13, 2011 at 14:34 | comment | added | Jeroen | I will do that. | |
| Jul 13, 2011 at 14:27 | comment | added | John Conde♦ | I read somewhere that Google encouraged this. I haven't been able to find the link again, though. I keep getting bad SEO websites instead. But if you want to be on the safe side take the HTML sitemap route. Not only can it do the same thing but you gain the advantage of having more pages on your site and anchor text to boost the rankings of those search pages and the other main pages of your website. | |
| Jul 13, 2011 at 14:20 | vote | accept | Jeroen | ||
| Jul 13, 2011 at 14:20 | |||||
| Jul 13, 2011 at 14:20 | comment | added | Jeroen | But isn't it true that google doesn't like pages in a sitemap that have no direct link in the website? Once i tried that and initially it seemed to work but after a while all those pages disappeared from google. I like your idea with the search results. | |
| Jul 13, 2011 at 13:58 | history | answered | John Conde♦ | CC BY-SA 3.0 |