The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

4
votes
6answers
176 views

How do you prevent web pages from appearing in the Google search index?

I have some web pages that Google has indexed. I have now added a robots.txt file to exclude them, but should I also add a noindex tag? If so, then how do I do so?
4
votes
2answers
1k views

Does using OpenGraph meta tags help webpages to get indexed better?

I have actually been reading and thinking about adding OpenGraph meta tags to help people who are sharing my blog posts, and different information of my site on Facebook. From reading, that will help ...
4
votes
2answers
474 views

Is it bad for SEO to submit a partially finished site to Google?

Hypothetical Situation 1: I have a plan for an amazing large-scale website with lot's of really cool features, animations and interactivity. This will take a several months to completely develop. ...
4
votes
3answers
172 views

What is 'lack of original content'?

It is written everywhere that lack of original content is has a negative impact on ranking. But what is lack of original content? (I am not talking about duplicate content) I guess if you copy other ...
4
votes
1answer
274 views

Why does Google index pages of my blog in seconds, while pages on the rest of the website take longer to get indexed

I have a questions and answers website in Portuguese about a specific subject. My Q&A website also have a blog, on a sub-directory like www.site.com/articles. I had not written on the blog for ...
4
votes
2answers
332 views

Is it possible to find out whether one given page has been indexed?

When one submits sitemaps in Google Webmaster, Google may not index all pages of your site/blog. Is there a way to find out whether one specific page belonging to the sitemap has been indexed or not? ...
4
votes
2answers
585 views

Redirecting URLs when launching a new website - how to avoid dropping page rank

i have over 100 urls in my website which i need to redirect: E.g. /page/how-to-bake-chocolate-cookies/ will redirect to /cookies/how-to-bake-chocolate-cookies/ /page/contact/ will redirect to ...
4
votes
2answers
349 views

Is content inside IE conditional comments indexed by search engines?

Although I'm aware of the various methods to show content only to users of a specific IE version, I was wondering if using conditional comments would have an effect on the way my site is indexed. If I ...
4
votes
2answers
193 views

How to determine why a page is banned by Google

There is a website which is correctly indexed by Google. And there is a page which was correctly indexed initially but after a couple of week was removed from the Google index. Most probably a page ...
4
votes
6answers
5k views

How can I get a list of all indexed pages for my domain?

We're in the process of migrating an outdated e-commerce cart to Magento. Part of this process will entail configuring proper 301 redirects. I'm aiming to get a list of all indexed pages to throw ...
4
votes
2answers
140 views

Seo Fake backlinking from other sites

The title might be a little bit confusing. Well, I noticed that someone had used a page's URL for backlinking or indexing his keywords. This is what he did: The normal url: http:// ...
4
votes
2answers
640 views

Informing Google of URL Structure Change

I have a website and the URLS were constructed like so: /index.php/Topic /index.php/AnotherTopic These were indexed in google and search results returned that pointed to these. However, I've ...
4
votes
1answer
59 views

Google is displaying a URL in my site's index with the cache of that result being completely different

Ok, this may turn out to be a silly question but I have observed Google displaying a URL in the index with the cache of that result being completely different when it shouldn't even be there in the ...
4
votes
3answers
2k views

Why are my posts omitted from Google search results when my site is listed in it?

My domain is not new at all, in fact I have waited for quite a long time now for Google to show some love. If I do a search for my domain name, it shows the website is listed, but if I try to search ...
4
votes
1answer
130 views

Will switching from home grown news page to a Facebook feed hurt SEO?

We are thinking of dumping our home curated news page and going to an embedded Facebook feed instead. One of the purposes of the news page is to boost SEO. The intention is that keywords will occur ...
4
votes
3answers
680 views

“X-Robots-Tag: noindex” on an HTTP 301 response

I understand that a resource with X-Robots-Tag: noindex forces some search engines, including Google, not to index the resource further. I also understand that an HTTP 301 response causes search ...
4
votes
2answers
208 views

Where does the Google `site:` operator for site-specific searches get its information?

I have read in many places that one should use Google Webmaster preferably to the site: search operator. However, I would like to know where the site: operator gets its information from? Here is my ...
4
votes
3answers
137 views

My archives are beating my current content, how do I stop from competing against myself?

I've inherited a site with about 15,000 pages going back 16 years. Often current events are outranked by previous events. What are the best techniques to make sure that I'm not fighting against ...
4
votes
3answers
419 views

Can Google Bot index transcript of YouTube hosted video?

We have a number of videos on YouTube, which we embed on our site via iframe/object stuff. Now we want to gain more SEO value by indexing video transcriptions. I have checked one of our video on ...
4
votes
1answer
78 views

Pre-Launch Indexing - Is it good to posting on-topic content for indexing prior to launch?

Is it worthwhile to put up some content, sans design, just for the purpose of getting indexed on the topic/product of the site that will be launched. For example: Domain = ...
4
votes
2answers
1k views

Understanding Google Webmasters Tools Sitemaps Information

So, I'm an 'avid' user of google webmaster tools and analytics. I'm building an e-commerce site, all with original product descriptions and a base of 'useful' industry-relevant content. I generated ...
4
votes
3answers
287 views

Why is the number of pages on my website indexed by Googlebot decreasing?

I am monitoring the number of pages indexed by Googlebot for one of my websites . I noticed that since last week, the number of pages has dropped by about 60 or so. Now to be fair, I have not added ...
4
votes
1answer
52 views

Moving folder's content to a new domain, what SEO steps to take?

So, we have a functionality on example.com/folder that we decided to make as separate site and we're in need of moving it to a new domain (brand it)... This is what I'm going to make SEO wise ...
4
votes
1answer
60 views

Using robots.txt to deny access to MediaWiki special pages using substring matching

I am running a Mediawiki at the domain someurl.com/wiki/. Unfortunally it generates a bunch of automatically generated Special pages which mainly are of low quality but nevertheless are massively ...
4
votes
1answer
707 views

I used rel=“canonical” and hreflang=“x-default”, but global site is missing and receiving “no return tags” error

Here is a sample of the code <link rel="canonical " href="http://www.kaspersky.com/anti-virus-trial" hreflang="en" /> <link rel="alternate" ...
4
votes
3answers
391 views

Is it safe to block redirected (but still linked) URLs with robots.txt?

I have a website that has all URLs optimized and 301 redirected from nasty URLs to clean ones. However, everywhere throughout the site the unclean URLs are linked in menus, content, products, etc. ...
4
votes
1answer
58 views

Why doesn't Google index the translated versions of my page?

I have a website in Persian language and translated some of my popular posts into English and added this header in <head> section in both of the pages (not entire site): <link ...
4
votes
2answers
110 views

Preserve search engine rankings while shifting to new domain name

We have to shift our web-site to a new domain due to some unavoidable circumstances. The portal has been up and running there since 2009. It has good index in various search engines and we are ...
3
votes
1answer
73 views

Replace all images when search engine crawler visits site

I have written code that will detect when a user is a search engine and i dont include css files when this happens to save bandwidth. I was also thinking i could replace ALL images on the page with a ...
3
votes
4answers
641 views

Should I use 'robots.txt' or 'sitemap.xml' to get dynamically created files indexed in search engines?

I've structure my video site like this: / (root) index.html -/videos -/video-id1 (dynamically generated subdirectory when user uploads a video) /index.html (dynamically generated file ...
3
votes
4answers
283 views

How sitemap.xml influences indexation?

If a page is missing in sitemap.xml (but crawable through HTML hyperlinks), may this cause it not to be indexed? (I mean it would be indexed without sitemap, but not indexed with sitemap because it is ...
3
votes
1answer
3k views

how to make sure an individual website is not indexed by search engines?

I'm setting up a personal website with a blog that I would like to be indexed by search engines. But the blog will link to CV with personal information that shouldn't be indexed. Can it be reliably ...
3
votes
3answers
97 views

Does Google index portions of the page that are unique and ignore the duplicate content?

When a page has content on it that is also on other pages on the site but also some unique content, how does Google handle it? Does Google: Index the entire page (including the duplicate content) ...
3
votes
4answers
881 views

Why doesn't Google remove my noindex and 404 pages?

I've added 404 error codes and no-index meta tag to pages quite some time ago. However, when I check in Google Webmaster Tools, looking at the graph of "removed" pages from their index, I see very low ...
3
votes
2answers
56 views

Will indexing an underdeveloped website result in a Google penalty?

My website is still undergoing multiple changes. When I search my website's indexed pages, I find many unwanted pages in search results. There are still many categories that need to be uploaded. ...
3
votes
3answers
112 views

How to prevent a search engines from indexing a section of a page?

I have many pages with lots of text in it. But I will always have two sections of text and I want to prevent one section from appearing in search results, the other section must be indexed. <p ...
3
votes
1answer
1k views

Search Engine Indexing of a Database-Driven Website

Suppose I have a MySQL whose rows are dog breeds and whose columns are properties of the breeds (e.g. coat color). The purpose of the site is to allow users to query the database with questions like ...
3
votes
3answers
317 views

Changed my blog's URL: what next?

I started working on a blog from last month. My blogs URL was quite big (for ex. http://my-old-long-url-blog.blogspot.com). I used it because I thought having 2-3 keywords in my URL will help me (I am ...
3
votes
2answers
521 views

How can I get Google to not index archive pages in Blogger?

I'm using Blogger with a custom domain. When I use the Google search site:example.com, the top results are in the form Example: 2010-01-10. These are archive pages that Blogger generates. My relevant ...
3
votes
1answer
175 views

Are text links indexed by Google?

We know that text links do not pass PageRank or signals, but say a page A contains a text link (not wrapped inside <a> </a>) to a page B and there is no other link on the net to page B and ...
3
votes
1answer
79 views

Two kinds of Google index

I am curious about information that gave me Google's Webmaster Tools. Because I see two different information about Google index of same webpage in same time. First information (sitemap files) I ...
3
votes
1answer
195 views

Should paginated sites be included in sitemap?

My website is ad listing for boats, boats' engines, boat rentals, etc (www.mynautics.com). There are ads listed on multiple pages. I have finished (not jet seen on link above) pagination: added ...
3
votes
5answers
1k views

How to let Google know that content on the page has just changed?

I'd never thought of such a problem in the whole SEO spectrum before I considered launching my own website. Imagine that I have a website which is updated once per month and Google spider knows ...
3
votes
1answer
2k views

Indexing a multilingual website

I am trying to create a multilingual website using the Django framework, all default content is English. I have added a native translation (Dutch). https://mydomain.com/ redirects to the user request ...
3
votes
3answers
3k views

Google webmaster Index Status. Total Indexed=0

I previously changed my domain from www.visualstudiolearn.blogspot.com to www.visualstudiolearn.com. I had around 300 posts with the previous domain name and most of them where showing up on Google. ...
3
votes
2answers
2k views

What does Google do with indexed pages returning 403?

I guess that Google removes already indexed pages that are now returning the HTTP error 403. Unfortunately I can't find any definitive statement on that matter. Do you know the answer?
3
votes
6answers
3k views

How quickly does Bing index URLs submitted through Webmaster Tools?

In Bing's Webmaster Tools, there is a Submit URLs page that allows you to "Submit URLs that are currently not in the Bing index or that should be reindexed due to recent changes." Does anyone know ...
3
votes
1answer
64 views

Does using the noarchive tag affect the page rankings?

Has anyone heard of any ranking impact for the pages where the noarchive tag is used? They are indexable (and indexed), but just wondered if there are any case studies showing that disallowing Google ...
3
votes
1answer
2k views

Is there a way to bulk submit URLs to Fetch as Google?

Google is taking a while to re-index changes I have made to thousands of pages, so I want to use Fetch as Google to give it a prompt. However, you can only enter 1 URL at a time as standard. Is there ...
3
votes
7answers
102 views

Will a missing <head> tag prevent Google from indexing a WordPress site?

I was recently trying to configure a Google Webmasters Tools account for a client. I spent almost an hour wondering why I couldn't get the site to validate, when I found that the opening tag was ...