All web resources crawled by Google bots and recorded in Google databases.

learn more… | top users | synonyms

0
votes
1answer
51 views

Is robots.txt preventing indexing of this site?

Our website http://www.example.com has a sub-domain http://jobs.example.com that uses a tool which shares our job listings. We would like for job listings to become indexed in Google search results. ...
4
votes
3answers
8k views

How to stop certain urls from being indexed

When I type site:example.com(using my domain obviously), I get several link errors showing up in the listing. Typically, they are of the form: /some/fixed/path/admin/unblockUser/11 I am thinking of ...
0
votes
0answers
12 views

robots.txt that allows only Google and Bing [duplicate]

Is it possible to create a robots.txt file that disallows everything except for Google and Bing? Something like: User-agent: * Disallow: / User-agent: Googlebot Allow: / User-agent: Googlebot-News ...
2
votes
1answer
427 views

Where are the complete set of Highwire Press metatags defined?

In the Google Scholar Inclusion Guidelines for Webmasters , it is suggested that one use the tags defined by "Highwire Press". Example: <meta name="citation_title" content="Article Title"> ...
3
votes
1answer
2k views

Google Webmaster Tools Index Status 0 for one year

I've read this topic with answers but they do not address why zero for one year? but other areas in Google Webmaster Tools report 400 URL indexed. Google Webmaster Tools Index Status Only 2 Indexed. ...
2
votes
4answers
90 views

How do I improve the rate at which Google crawls my website?

Google is not crawling my website. I want to be in the search results as soon as possible. How do I get Google to crawl faster?
2
votes
1answer
659 views

Permanent redirections after changing the product links structure on Prestashop

I'm looking at changing the products URLs' structure on a Prestashop (v1.5) website. This process is quite straight-forward and it can be done instantly through the corresponding admin panel. The ...
0
votes
0answers
8 views

Make search engines index options of the select box [duplicate]

My website have some important links in some menus that lead to thousands of pages that they are already indexed in google, as these menus were not working nice in mobiles, in my new design I want to ...
2
votes
3answers
1k views

Why is Google Webmaster Tools account showing fewer indexed pages than a site: search?

When I have check my website index pages it is showing only 252 pages are indexed but when I checked through Google Search by typing site:http://www.example.com then is showing more then 900 pages are ...
4
votes
2answers
679 views

Microdata for product images which aren't displayed in the page?

My internet shop displays thumbnails of products' images, and I see that these thumbnail are (slowly) being indexed by Google. I want also full images to be indexed. Can I use Microdata for this? ...
0
votes
0answers
21 views

URL Dynamically changes after first edit

We are developing a magento eCommerce website with main category pages, sub-category pages and details page along with other static pages. Our condition is if any miss-spelled URLs entered directly ...
0
votes
2answers
44 views

Search engine indexing based on user country

I got two domain names company.com company.jp Each domain has its own website with different content hosted on same server but different accounts, the purpose is to display optimized website and ...
0
votes
0answers
15 views

Google Indexed demo site with same content [duplicate]

I have two server one is production abc.com other demo.abc.com problem is Google has indexed the demo server as well. What is fastest possible fix to it and to remove it from Google index? What ...
2
votes
0answers
39 views

Webpages being de-indexed seemingly for no reason [duplicate]

Last Wednesday my site had a ton of its paged de-indexed by Google and it's caused a drop of over 60% in overall site traffic :(... One of the pages used to rank first page #1-3 and now it doesn't ...
4
votes
2answers
598 views

Informing Google of URL Structure Change

I have a website and the URLS were constructed like so: /index.php/Topic /index.php/AnotherTopic These were indexed in google and search results returned that pointed to these. However, I've ...
2
votes
1answer
79 views

301 redirect: does Google automatically update its index to the new URL?

If I do a site wide 301 redirect from HTTP to HTTPS, will Google update its index with the new URLs?
0
votes
0answers
123 views

How long does it take to re-index the website via noarchinve tag?

I read elsewhere on here that one can't re-index their site with google, but I like to challenge that. Currently, I have every page on my website (that contains about 1,000,000 pages) labeled with a ...
1
vote
1answer
193 views

Multiple Sitemaps Doesn't Index Quickly - How To Get Quick Index

I have a serious problem in my site: http://www.coimbatorematrimony.com I will create multiple sitemaps.xml with all terms & conditions of Google Webmaster and some other search engines. I have ...
3
votes
3answers
608 views

How to make Google index millions of user profile pages?

I have a website with a lot of user profiles (like LinkedIn or the like). I need Google to index each public user profile page. I have a few things on my mind: 1- There is no user listing on my ...
0
votes
1answer
52 views

Remove dynamically generated sitemap from google search result [duplicate]

I use Yii PHP framework to generate sitemaps of user profiles. The sitemap url is something like this http://mywebsite.com/site/sitemap33449 This URL returns xml of the sitemap. (with correct ...
0
votes
3answers
298 views

Best way to replace/publish the restructured website in SEO friendly manner

I had a website which contains several subdomains. http://sub1.example.com/stories/23/job-done.html http://sub2.example.com/stories/23/job-done.html At present I decided to restructure my website ...
1
vote
1answer
136 views

Why Google indexed the preview URL of domain?

I have some problems when the web host updated the plesk desk and the server. I looked to see which pages are indexed site:www.charchas.gr and then I looked for the preview ...
11
votes
1answer
600 views

Why are these sites cloning my content, and how do I stop them?

So I was searching for one of my own websites on Google: http://www.botlibre.com and to my surprise found some clones of my website, like: http://83waystowasteyourtime.adidas.com and: http:// ...
1
vote
0answers
36 views

Google Indexes are getting reduced day by day [closed]

This is what I did, first the site was indexed and we had over 10 lacks indexed entries, but some time later, our site links yields 404 for some of them and indexes were also getting reduced. Later we ...
2
votes
1answer
162 views

Google indexed my website name with a space

Google has indexed my website name with a space between 2 words. Search intellisense shows my website name with a space between both the words. Ex: word1 word2 (Stack Overflow) What I want is that ...
4
votes
2answers
4k views

Why the number of indexed pages decreased for a “site:” search

Recently I created a website with hundreds of thousands of unique pages. A week ago, Google had indexed about 250,000 pages. It has now decreased to 90k URLs (using a site:domain.com query). What ...
1
vote
1answer
96 views

How to prevent Google from indexing redirects to external URLs as part of the originating domain?

We have links to external URLs implemented with HTTP 301 redirects for the purpose of counting clicks. Searching our site in Google using the site: modifier results in the redirecting URLs returned ...
0
votes
0answers
25 views

How do I get Google to index my 30 million pages? [duplicate]

I am releasing a website which has 30 million pages of content. (This isn't spam material). It has a detail page for each of the 30 million places around the World. e.g ...
3
votes
3answers
337 views

SEO blog Indexing: wordpress.com subdomain vs a registered domain?

I've used WordPress for a few of my client's sites, mostly small businesses and eCommerce sites. I have found through Google Analytics as well as the All in One Webmaster plugin that when it comes to ...
0
votes
0answers
150 views

X-Robots-Tag: noindex on an HTTP 302 response to remove subdomain

This very related to this question "X-Robots-Tag: noindex" on an HTTP 301 response, however I don't see a definitive answer. We have subdomains we use for our affiliate links, the ...
1
vote
1answer
118 views

Google's cache (text version) does not show hyperlinks

I have list of product links on one of our website's page. For some reason when I view the google's cached version of this page, google strips out all the product links. Links in the header and footer ...
1
vote
1answer
576 views

How to force Google to index images and webpages? Or I shouldn't bother and just wait a bit more?

I have a web site with a lot of web-pages and images. I created the sitemaps (grouped into single sitemaps index file). I submitted those sitemaps to Google but the indexing process is disappointingly ...
3
votes
1answer
76 views

Two kinds of Google index

I am curious about information that gave me Google's Webmaster Tools. Because I see two different information about Google index of same webpage in same time. First information (sitemap files) I ...
0
votes
1answer
27 views

What does it means when someone cannot find a specific webpage by site: in Google?

What does it means when someone cannot find a specific webpage by site: in Google? The page was indexed by Google earlier but cannot be found even with site: operator. What will that mean?
2
votes
3answers
947 views

What to do if Google starts to index fewer pages from your site?

How do I find out why Google is now indexing fewer pages from my site? Here is what Google's help says although I don't find it that helpful: A steady increase in the number of crawled and ...
0
votes
2answers
48 views

How to remove a page from the Google search results [duplicate]

Google says one can use the following method to remove a page from the search results: by putting -http://www.example.com/outdated.html into the sitemap. But what if the site does not exist anymore.
1
vote
3answers
40 views

Older post not indexed, new post indexed right away?

I have a post I created yesterday that was indexed rather quickly by Google. However, I have two other post that I created within the past 4 days that are not indexed and I cannot find a trace of ...
1
vote
1answer
46 views

Will a Cloned Site Get Indexed Without Links to Inner Pages

I've cloned a site to a new domain just to use the functionality of the site. Everything will be different on the new domain, but there are a lot of left over files and you can access URLs that are ...
1
vote
2answers
571 views

Google still has record of my old site URL - what to do?

I had a blog site, i.e. http://example2.com, then I bought a new domain, i.e. http://example.com and 301 permanent redirected example2.com to example.com. But when I get into the Google Webmaster ...
9
votes
3answers
2k views

How do I find when an URL was first indexed by Google?

How do I find out when a particular URL was first indexed by Google? I'd prefer a solution that works even for competitors' URLs that are not owned by me.
3
votes
1answer
215 views

Single page not appearing in Google Search

Description I have a static franchise website which has various sub pages each dedicated to an individual franchisee. For each franchisee the page, the only thing slightly similar between all of ...
2
votes
4answers
261 views

How long for Google to index all site maps?

We recently uploaded new sitemaps, as the old ones were out of date and we've also upgraded our forum which changed the URLs of a lot of our website (we're 301 redirecting of course). We uploaded the ...
2
votes
3answers
122 views

Having issues getting new pages indexed in Google

We are having issues getting our new pages crawled by Google and cannot figure out why. We've done lots of research and are still having trouble finding answers. Here's some information regarding our ...
1
vote
3answers
139 views

How much time for robots.txt to remove my website from google

I created a robots.txt file in my root but the website is still indexed by Google. How much time for robots.txt to remove my website from Google?
2
votes
1answer
54 views

Why my webpages body content is not taken into account to display in google SERP?

It's confusing for me that I have content on my webpages, however, when I search with the site: operator it is not taken into account. There is something like "Thank you for contacting us...." ...
1
vote
1answer
451 views

Point custom domain to single webpage hosted on Dropbox

I have a static html page that I would like to host in Dropbox's public folder and make accessible by a domain of mine, e.g example.org. The html page has the following url structure ...
4
votes
3answers
1k views

nofollow doesn't stop crawling?

In my website, most of the pages has a linkedin sharing button written in this way: <li> <a id="share_linkedin" ...
4
votes
5answers
6k views

How can I force Google to re-index my site?

I changed the structure of my URLs. The pages are already indexed by Google and have the following structure: /myfolder/page.apsx The new structure is: /page.aspx Now all URLs that Google knows ...
0
votes
0answers
23 views

My site is indexed, but not showing up in results [duplicate]

According Google Webmaster Tools, my site, www.yomkippurshoes.com is being indexed. However, when I try to find it in results (e.g. type site:yomkippurshoes.com in Google), I don't see it in the ...
3
votes
1answer
226 views

SEO - Does Google properly handle hreflang tags with links that just change the language settings in a session cookie?

I am currently working on a website that is available in multiple languages. I put some effort in atomatically detecting the users preferred language. This itself is working great. I also offer ...