All web resources crawled by Google bots and recorded in Google databases.

learn more… | top users | synonyms

4
votes
2answers
1k views

SEO - Delete old indexed pages from Google 301 vs 404?

We're launching new website with new url structure and new content. Domain is the same. Many old pages are indexed by google. Should I use 404 or 301 and redirect to '/' for these old resources? I ...
5
votes
1answer
222 views

should I block wordpress archive pages from search engines?

I use WordPress and /sample-post/ URLs for my posts and /yyyy/mm/ for the archives. Google has indexed the site fully. Since the archives currently display full posts I've thought that I shouldn't ...
3
votes
3answers
190 views

Delay before getting URLs into Google's in web index?

4 days ago, I have submitted a sitemap.xml into Google's WebMaster Tool for a new website. It contains 3 entries. I have tested the site map and Google found not errors. In about how much time can I ...
2
votes
2answers
1k views

Why the number of indexed pages got decreased?

Recently I have created a website with hundreds of thousands of unique pages. A week before Google indexed about 250,000 pages but it has decreased to 90k urls today (site:domain.com). What should I ...
1
vote
3answers
171 views

Why isnt google crawling on my blog? [duplicate]

I have a blog.I made it on August,2010,so it has been a while but I am unable to make Google crawl on my site.I have requested Google to crawl but I still there is no response.Any reasons to note why ...
2
votes
1answer
122 views

Is making AJAX site crawlable AND degrading gracefully with JS turned off possible?

According to this spec, making AJAX site crawlable by Googlebot means that you have to use hashbang (#!) links in it which means it won't degrade gracefully when JS is turned off. This might mean that ...
8
votes
3answers
2k views

Does Google cache robots.txt?

I added a robots.txt file to one of my sites a week ago, which should have prevented googlebot from attempting to fetch certain URLs. However, this weekend I can see googlebot loading those exact ...
5
votes
3answers
215 views

Removing full site from Google index

I want to remove the contents from Google index. Google index include my websites huge number of pages indexed in Google index about 5,000,000 Pages earlier but now left pages are 3,025,000. I have ...
4
votes
3answers
547 views

nofollow doesn't stop crawling?

In my website, most of the pages has a linkedin sharing button written in this way: <li> <a id="share_linkedin" ...
3
votes
2answers
410 views

Google crawling the site but refusing to index dynamic content

I am trying to get Google to index an AJAX site (davidelifestyle.com). It's crawlable with JavaScript turned off and I have also recently implemented _escaped_content_ snapshot mechanism but all ...
3
votes
1answer
85 views

How can I force a certain URL for Google to use in search results?

Each page on my site can be accessed by a shortened URL and normal "long" URLs. The shortened URL redirects to the long URL and the long URL includes an optional title that's not parsed (much like on ...
1
vote
3answers
471 views

I have so much “not selected” index

This is a screen shoot from web master tools. It shows I have a large number of "not selected" pages, first I thought if I fix duplicate content with 301 redirects and a sitemap, the problem will be ...