All web resources crawled by Google bots and recorded in Google databases.
4
votes
2answers
1k views
SEO - Delete old indexed pages from Google 301 vs 404?
We're launching new website with new url structure and new content. Domain is the same.
Many old pages are indexed by google. Should I use 404 or 301 and redirect to '/' for these old resources? I ...
5
votes
1answer
224 views
should I block wordpress archive pages from search engines?
I use WordPress and /sample-post/ URLs for my posts and /yyyy/mm/ for the archives.
Google has indexed the site fully.
Since the archives currently display full posts I've thought that I shouldn't ...
3
votes
3answers
190 views
Delay before getting URLs into Google's in web index?
4 days ago, I have submitted a sitemap.xml into Google's WebMaster Tool for a new website. It contains 3 entries. I have tested the site map and Google found not errors.
In about how much time can I ...
2
votes
2answers
1k views
Why the number of indexed pages got decreased?
Recently I have created a website with hundreds of thousands of unique pages. A week before Google indexed about 250,000 pages but it has decreased to 90k urls today (site:domain.com). What should I ...
1
vote
3answers
171 views
Why isnt google crawling on my blog? [duplicate]
I have a blog.I made it on August,2010,so it has been a while but I am unable to make Google crawl on my site.I have requested Google to crawl but I still there is no response.Any reasons to note why ...
2
votes
1answer
122 views
Is making AJAX site crawlable AND degrading gracefully with JS turned off possible?
According to this spec, making AJAX site crawlable by Googlebot means that you have to use hashbang (#!) links in it which means it won't degrade gracefully when JS is turned off. This might mean that ...
8
votes
3answers
2k views
Does Google cache robots.txt?
I added a robots.txt file to one of my sites a week ago, which should have prevented googlebot from attempting to fetch certain URLs. However, this weekend I can see googlebot loading those exact ...
5
votes
3answers
215 views
Removing full site from Google index
I want to remove the contents from Google index. Google index include my websites huge number of pages indexed in Google index about 5,000,000 Pages earlier but now left pages are 3,025,000.
I have ...
4
votes
3answers
550 views
nofollow doesn't stop crawling?
In my website, most of the pages has a linkedin sharing button written in this way:
<li>
<a id="share_linkedin"
...
3
votes
2answers
412 views
Google crawling the site but refusing to index dynamic content
I am trying to get Google to index an AJAX site (davidelifestyle.com). It's crawlable with JavaScript turned off and I have also recently implemented _escaped_content_ snapshot mechanism but all ...
3
votes
1answer
85 views
How can I force a certain URL for Google to use in search results?
Each page on my site can be accessed by a shortened URL and normal "long" URLs. The shortened URL redirects to the long URL and the long URL includes an optional title that's not parsed (much like on ...
1
vote
3answers
471 views
I have so much “not selected” index
This is a screen shoot from web master tools. It shows I have a large number of "not selected" pages, first I thought if I fix duplicate content with 301 redirects and a sitemap, the problem will be ...