The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

0
votes
1answer
91 views

How to find out which images are indexed by Google

I just tried to make request like site:example.com in Images section of Google search. There were about let's say 100 images found (no "Show more results" or any similar was available in the bottom). ...
1
vote
2answers
291 views

Preventing links with query parameters from being indexed by Google

I manage a mobile version of a desktop site. The mobile site has an mdot subdomain and is served from a different server. As part of recommended best practices by Google, I've included a link on the ...
0
votes
0answers
15 views

How to prevent Google (and others) from indexing the site under construction? [duplicate]

Recently I faced with the situation that the wrong site pages (with wrong URLs, wrong content) was indexed by Google during the site developing. Should I place robots.txt with User-agent: * Disallow: ...
2
votes
3answers
591 views

Why is Google Webmaster Tools account showing fewer indexed pages than a site: search?

When I have check my website index pages it is showing only 252 pages are indexed but when I checked through Google Search by typing site:http://www.example.com then is showing more then 900 pages are ...
1
vote
1answer
271 views

Can Google bots interpret hyphen separated words as a single keyword?

I have a french website which frequently includes the word rendez-vous. But, Google Webmaster Tools content keywords tells me the #1 keyword is rendez which is not what I want. Even worse, the word ...
1
vote
2answers
47 views

sitemap.xml approach on non-indexed site

On a site that has a robots.txt file that disallows all crawling... User-agent: * Disallow: / ...does it matter what the sitemap.xml content is? Is it better, or does it make a difference at all, ...
0
votes
1answer
67 views

Multiple images on one page: best ranking practices

I have several images related to one object and they all should be placed on one web-page. I'd like to know how do I place those images among the page body and its text. I can not do it manually to ...
2
votes
2answers
84 views

Can you create a private website without password protection that would not be indexed?

I'd like to create a "private" website that clients can visit by typing in the provided direct URL (on a business card, for example), but is not password protected and would not be indexed by search ...
0
votes
2answers
2k views

How long does Google Webmaster Tools take to index a website?

How much time does Google Webmaster Tools take to index a page? Analytics took around 24 hours to get info from the site, but since this is indexing, I guess it might take a little bit more than that. ...
1
vote
2answers
123 views

Search engines that index your site despite a disallow in robots.txt

Recently, WordPress changed their options from "Block search engines" to "Discourage search engines" So that leaves me wondering, that rewording must be that some search engines disregard your ...
1
vote
0answers
13 views

How do services that make subsites (ie. new subdomains) get those sites indexed by Google and other search enginex? [duplicate]

Services like tumblr, github pages, quora blogs, etc. make new subdomains when a user signs up or makes a site. So the subdomains are like: blogname.tumblr.com , pagename.github.io, ...
0
votes
1answer
60 views

How to use wildcards to remove print pages from search engines?

Our site has pages that are print-friendly, which I would like to remove from search engines. Here's an example: ...
2
votes
1answer
82 views

Do sites using YouTube video API get indexed by Google?

Suppose I design a small app that heavily depends on Google YouTube API to dynamically fetch hundreds of YouTube video data. My site will be able to respond to users' requests, and generate several ...
1
vote
3answers
297 views

In WordPress, should I “Allow search engines to index this site” during development?

I am going to create a web page, and I will do it online. Should I choose the option: "Allow search engines to index this site." during development, or should this be opened after development ends?
1
vote
1answer
90 views

Google showing meta descriptions from other pages in the SERPs [closed]

Recently I added some content to my website and submitted a sitemap files to Google. Now that Google has indexed those pages, I discovered that some of words and sentences that are listed in Google ...
2
votes
2answers
583 views

301 redirect from HTTP to HTTPS - how to be sure Google is fetching the correct information?

I'm hoping somebody might be able to provide a bit of advice on an issue I am having. I have one site where we implemented a 301 redirect on the homepage from HTTP to HTTPS. We have links on the ...
3
votes
3answers
84 views

How to prevent a search engines from indexing a section of a page?

I have many pages with lots of text in it. But I will always have two sections of text and I want to prevent one section from appearing in search results, the other section must be indexed. <p ...
0
votes
0answers
18 views

Getting rank for keywords that I don't want to appear on my website [duplicate]

One of my products has two names. One of them is what I consider correct and thus it is what I want to appear on my website. The other name is incorrect for me, so I would like to avoid it. But I know ...
5
votes
1answer
818 views

Can you use googleon and googleoff comments to prevent Googlebot from indexing part of a page?

I've seen code like for preventing Google from indexing part of a page: <p>This is a paragraph that will be indexed by Google.</p> <!--googleoff: index--> <p>This is a ...
0
votes
1answer
82 views

Search engine bots accessing strange URLs

We have ELMAH enabled on our site and get errors whenever a Page Not Found error is triggered on the website. We have recently redesigned a new website and so we understand that search engine ...
1
vote
1answer
113 views

Will Google Scholar index the papers on my website?

I have just requested that Google Scholar collect the papers from my personal web site: http://cs.uic.edu/~asmirnov/publications.html I was wondering if I did everything right: I submitted a ...
2
votes
1answer
273 views

Google indexing fewer images after switching to CDN

After switching to a CDN I noticed that my indexed image count went down. I have close to 1000 images on the site with correct tags, alt tags, and all of that. Only 50 are actually being indexed in ...
0
votes
3answers
657 views

De-index URL parameters by value

Upon reading over this question is lengthy so allow me to provide a one sentence summary: I need to get Google to de-index URLs that have parameters with certain values appended I have a website ...
2
votes
3answers
224 views

Is it safe to block redirected (but still linked) URLs with robots.txt?

I have a website that has all URLs optimized and 301 redirected from nasty URLs to clean ones. However, everywhere throughout the site the unclean URLs are linked in menus, content, products, etc. ...
4
votes
3answers
145 views

What is 'lack of original content'?

It is written everywhere that lack of original content is has a negative impact on ranking. But what is lack of original content? (I am not talking about duplicate content) I guess if you copy other ...
1
vote
1answer
55 views

Should webmasters “index” dashboard and edit account page

New here, I did my research and found nothing, but sorry if it has already been asked. As webmasters should be let google and other search engine INDEX our member's dashboard and edit account page. ...
1
vote
1answer
108 views

Is this a proper way to deal with near duplicate content?

I have a website which used to have 22.000 pages with near duplicate content. Of course, this has become a Panda issue. These pages are now gone from my site and the Google index. I have decided to ...
0
votes
1answer
64 views

SEO: why this site won't index? [duplicate]

I recently built a one-page-site, All main pages are loaded via ajax, so they exist as standalone too versions as well in HTML format through jQuery, only pages' content is loaded in the ...
1
vote
0answers
20 views

Adding http:// in internal links [duplicate]

I was wondering if adding http:// into my links was a bad thing for SEO optimization. I know that is unnecessary but I have several links that are displayed in multiple subdomains. I try to explain ...
2
votes
4answers
666 views

Google crawl speed — how fast can it go?

I have a huge website with 5 million pages. Currently Google indexes about 10,000 pages per day. This is very slow, I still have lots of pages that I can't get indexed. Does anyone know what is the ...
0
votes
1answer
125 views

Need Google to recrawl the pages

I've changed the meta description tag in many of my site pages. Should I select Fetch as Google->Fetch->Add to Index->URL and all linked pages in GWT? Will Google recrawl the whole site faster than ...
0
votes
3answers
67 views

Is there a way to obtain a list of the links that Google has crawled?

I was concerned that Google was not obtaining all the links on my site during their crawl, but after going into Google Tools it seems I have a few hundred URL's indexed every week (approximately), ...
1
vote
1answer
187 views

Will Google index a PHP header redirect?

I have a new domain which has an index.php file. Inside this file, I get user's IP, save it and redirect to another page on another domain. So there is no output, only header info. Will Google index ...
0
votes
2answers
140 views

Opening forum for search engine bots and SEO

We develop and sell components for other software developers through our website. The main products are ActiveX and WinFroms.NET grid controls. Some years ago we established a forum dedicated to our ...
1
vote
2answers
265 views

Google Webmaster Tools not showing index pages

I have submitted sitemap and also fetched pages of my sites but still its showing error like "domain with protocol https://www.domain-name is not available try with http://www.domain-name.html". ...
0
votes
4answers
139 views

How to exclude certain images on web page from spiders?

I have a page with a main image on it that I want to be indexed. I also have a list of other images (thumbnails) on the same web page that should not be indexed or associated with the current ...
1
vote
0answers
70 views

SEO strategy for multiple pages per entity [closed]

I'm trying to decide a good SEO strategy for a web-site with multiple pages per entity. For example, there are main pages for companies which summarize the main information and each sub-page and ...
0
votes
1answer
239 views

How to prevent webpages translated with Google Translate Plugin from being indexed?

I've been reading the information here https://support.google.com/translate/#2534535 about the Google Translate plugin. At first I thought that if I used the plugin my site wouldn't be indexed, but ...
4
votes
5answers
395 views

With Robots.txt disallow all, why was my site still getting traffic?

In failing to check my robots.txt on a community site, it had: User-agent: * Disallow: / I only clued into this because of a message in my AdSense account saying that five URL's couldn't be ...
0
votes
1answer
51 views

Is it possible to have Google index one page with one URL and have it link to another URL?

We want to tell Google to crawl a content heavy page but list a link to a much more performant JavaScript version of the page. Is this possible? I.e. Give Google a sitemap, then put canonical tags ...
4
votes
1answer
116 views

Will switching from home grown news page to a Facebook feed hurt SEO?

We are thinking of dumping our home curated news page and going to an embedded Facebook feed instead. One of the purposes of the news page is to boost SEO. The intention is that keywords will occur ...
1
vote
1answer
174 views

How do I prevent search engines from indexing a website duplicated on a second domain?

Let's say I run a website example.com with a dedicated IP A.B.C.D. Then I find out doing a search on Google, that my website is also being indexed through a domain A-B-C-D.example.com (where the ...
4
votes
4answers
3k views

How can I get a list of all indexed pages for my domain?

We're in the process of migrating an outdated e-commerce cart to Magento. Part of this process will entail configuring proper 301 redirects. I'm aiming to get a list of all indexed pages to throw ...
3
votes
3answers
399 views

“X-Robots-Tag: noindex” on an HTTP 301 response

I understand that a resource with X-Robots-Tag: noindex forces some search engines, including Google, not to index the resource further. I also understand that an HTTP 301 response causes search ...
1
vote
2answers
120 views

Is it possible for Google to discover a website that is not linked to anywhere? [duplicate]

My colleague claims that he has seen cases where websites were "discovered" by Google without having a link to them anywhere on the web. For him, this means that the only way to not being indexed ...
2
votes
1answer
58 views

Is this considered to be “Internal Near-Duplicates”?

Some people generate the same pages with a slight variation in keywords, title, country name, region name, etc... This is typically considered to be "Internal Near-Duplicates." I have seen a website ...
0
votes
0answers
17 views

Debugging reason for specific site sections with significantly low appearance in SERP [duplicate]

I'm experiencing very little exposure for specific sections in my site compared to different sections. Most of my traffic is long-tail queries, in the popular SERP, and non-popular SERP sections. I ...
2
votes
2answers
69 views

Should I have link rel=next & prev on URLs which have query variables?

For example, I have link rel prev & next set up on these pages of products: site.com?page=2 site.com?page=3 (this is my preferred structure by the way and I'm trying to get all the ugly URLs ...
4
votes
1answer
238 views

Why does Google index pages of my blog in seconds, while pages on the rest of the website take longer to get indexed

I have a questions and answers website in Portuguese about a specific subject. My Q&A website also have a blog, on a sub-directory like www.site.com/articles. I had not written on the blog for ...
1
vote
3answers
98 views

Using Ajax #! for Google but site is not being crawled any more

We used to have all links in a normal way (thus with parameters?), we changed to AJAX loading cause we installed a music player. Here's an example: Old link: ...