All web resources crawled by Google bots and recorded in Google databases.

learn more… | top users | synonyms

22
votes
6answers
2k views

Why isn't my website in Google search results?

I've made a website one month ago and it still isn't indexed by Google. I haven't change any setting in the robots.txt file. I've tried to search for site:websitename.com but I still can't see it, ...
3
votes
3answers
7k views

How to stop certain urls from being indexed

When I type site:example.com(using my domain obviously), I get several link errors showing up in the listing. Typically, they are of the form: /some/fixed/path/admin/unblockUser/11 I am thinking of ...
3
votes
2answers
3k views

Why the number of indexed pages decreased for a “site:” search

Recently I created a website with hundreds of thousands of unique pages. A week ago, Google had indexed about 250,000 pages. It has now decreased to 90k URLs (using a site:domain.com query). What ...
5
votes
2answers
2k views

SEO - Delete old indexed pages from Google 301 vs 404?

We're launching new website with new url structure and new content. Domain is the same. Many old pages are indexed by google. Should I use 404 or 301 and redirect to '/' for these old resources? I ...
11
votes
5answers
4k views

Does Google cache robots.txt?

I added a robots.txt file to one of my sites a week ago, which should have prevented googlebot from attempting to fetch certain URLs. However, this weekend I can see Googlebot loading those exact ...
7
votes
1answer
1k views

Should I block Wordpress archive pages from search engines?

I use WordPress and /sample-post/ URLs for my posts and /yyyy/mm/ for the archives. Google has indexed the site fully. Since the archives currently display full posts I've thought that I shouldn't ...
4
votes
2answers
225 views

Site restyling effecting Google ranking

I have to restyle a website in Drupal, and the client has a clear request: the site cannot drop its position on Google. If I build a new Drupal site, with the same URLs, the same meta and title tags, ...
4
votes
3answers
256 views

Delay before getting URLs into Google's in web index?

4 days ago, I have submitted a sitemap.xml into Google's WebMaster Tool for a new website. It contains 3 entries. I have tested the site map and Google found not errors. In about how much time can I ...
2
votes
3answers
183 views

Why isn't Google crawling on my blog? [duplicate]

I have a blog. I made it in August, 2010. It has been awhile, but I am unable to make Google crawl on my site. I have requested Google to crawl but there is still no response. Are there any reasons of ...
1
vote
1answer
26 views

Older post not indexed, new post indexed right away?

I have a post I created yesterday that was indexed rather quickly by Google. However, I have two other post that I created within the past 4 days that are not indexed and I cannot find a trace of ...
0
votes
2answers
202 views

Question about paginated based URLs and category URLs with XML sitemaps

I have a blog site that has this URL structure: http://website.com/category/ http://website.com/category/page1/ http://website.com/category/subcat/ http://website.com/category/article_title A flow ...
9
votes
2answers
151 views

How to tell how old a page is?

I thought Google was more or less accurate at determining who posted a text first and who copied. However, when I use the "search tool: customized interval" the results are quite odd. I've found pages ...
4
votes
2answers
200 views

Is making AJAX site crawlable AND degrading gracefully with JS turned off possible?

According to this spec, making AJAX site crawlable by Googlebot means that you have to use hashbang (#!) links in it which means it won't degrade gracefully when JS is turned off. This might mean that ...
7
votes
2answers
3k views

Google Webmaster Tools Index Status is 0 but sitemap URL shows indexed

I've added my site to Google Webmaster tools www.medexpress.co.uk. The site was submitted a few weeks ago. The index status shows 0 but it shows 6 URLs have been indexed in the sitemaps section. If I ...
8
votes
3answers
496 views

Dev site indexed by Google

I was developing a new version of our site on a subdomain (dev.oursite.com) and the robots.txt with the Disallow got replaced at some point, so the site got indexed by Google and other search engines. ...
7
votes
1answer
311 views

home page of my site is not appear in google search, when I type site:example.com

I am totally confused, when I place site:example.com in google I see every page of my website in serp(search engine result page) except the home page. I don’t know why it’s happening but I check ...
6
votes
3answers
623 views

Removing full site from Google index

I want to remove the contents from Google index. Google index include my websites huge number of pages indexed in Google index about 5,000,000 Pages earlier but now left pages are 3,025,000. I have ...
4
votes
2answers
124 views

google search index what is fresh content

I read that sites have good reputation in google search index if it is fresh content. what does fresh content means from google's point of view? I have many pages. I have created articles and ...
4
votes
2answers
690 views

Google crawling the site but refusing to index dynamic content

I am trying to get Google to index an AJAX site (davidelifestyle.com). It's crawlable with JavaScript turned off and I have also recently implemented _escaped_content_ snapshot mechanism but all ...
4
votes
3answers
874 views

nofollow doesn't stop crawling?

In my website, most of the pages has a linkedin sharing button written in this way: <li> <a id="share_linkedin" ...
3
votes
1answer
102 views

How can I force a certain URL for Google to use in search results?

Each page on my site can be accessed by a shortened URL and normal "long" URLs. The shortened URL redirects to the long URL and the long URL includes an optional title that's not parsed (much like on ...
1
vote
1answer
190 views

When does the 301-redirected URL gets indexed?

I had a page in my website like mysite.com/dir/page now I moved it to mysite.com/page , and the old URL 301-redirects to the new URL. When will it get updated in Google? I asked the bot to fetch it ...
1
vote
3answers
505 views

I have so much “not selected” index

This is a screen shoot from web master tools. It shows I have a large number of "not selected" pages, first I thought if I fix duplicate content with 301 redirects and a sitemap, the problem will be ...
0
votes
2answers
109 views

Google Webmaster Tools Index Status is 0 [duplicate]

Statistics show all entries of my wordpress blog have been tracked, but none have been indexed. I thought it would be just a matter of indexing delay, but it has been 3 weeks already, and I can find ...