The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

0
votes
0answers
2 views

Google images directing to url with Escaped Fragment

I'm running an ajax website with images and using Google's guidelines for ajax webistes. My site is indexed correctly in Google's web search. But in image search the _escaped_fragment_ appears in the ...
0
votes
1answer
13 views

How long for Google to index all site maps?

We recently uploaded new sitemaps, as the old ones were out of date and we've also upgraded our forum which changed the URLs of a lot of our website (we're 301 redirecting of course). We uploaded the ...
1
vote
1answer
18 views

Older post not indexed, new post indexed right away?

I have a post I created yesterday that was indexed rather quickly by Google. However, I have two other post that I created within the past 4 days that are not indexed and I cannot find a trace of ...
1
vote
2answers
98 views

Why is Google Webmaster Tools account showing less number of index pages?

When I have check my website index pages it is showing only 252 pages are indexed but when I checked through Google Search by typing site:http://www.example.com then is showing more then 900 pages are ...
1
vote
2answers
55 views

What is better for SEO robots.txt file or dynamically generated robots.txt URL?

I was relying on our custom WordPress package's dynamically generated robots.txt URL for a few sites but it was not being honoured by Google or Bing (plugin URLs were getting indexed despite the rule ...
1
vote
1answer
69 views

Google showing meta descriptions from other pages in the SERPs

Recently I added some content to my website and submitted a sitemap files to Google. Now that Google has indexed those pages, I discovered that some of words and sentences that are listed in Google ...
2
votes
4answers
60 views

Why doesn't Google remove my noindex and 404 pages?

I've added 404 error codes and no-index meta tag to pages quite some time ago. However, when I check in Google Webmaster Tools, looking at the graph of "removed" pages from their index, I see very low ...
0
votes
1answer
166 views

Google Webmaster Tools not showing index pages

I have submitted sitemap and also fetched pages of my sites but still its showing error like "domain with protocol https://www.domain-name is not available try with http://www.domain-name.html". ...
0
votes
1answer
100 views

Addon domains and SEO

I have a shared hosting account with a main domain and many add-on domains. I don't actually use the main domain, it just has a landing page. Can I tell bots not to index the main domain WITHOUT ...
2
votes
2answers
40 views

Would Google penalize me for removing indexed pages?

I'm about to remove a large part of a website in order to replace it by a better alternative which, unfortunately, cannot be mapped to older URIs with URL rewriting. The part of the website I want to ...
2
votes
1answer
66 views

Should paginated sites be included in sitemap?

My website is ad listing for boats, boats' engines, boat rentals, etc (www.mynautics.com). There are ads listed on multiple pages. I have finished (not jet seen on link above) pagination: added ...
0
votes
1answer
23 views

Remove page from Search Result Bunch [duplicate]

When I do a branded search for a website the structure shows like ( see image ). I would love to remove Privacy Policy page or Manipulate the structure I see now ( showing pages I want to ). How I can ...
3
votes
5answers
959 views

How quickly does Bing index URLs submitted through Webmaster Tools?

In Bing's Webmaster Tools, there is a Submit URLs page that allows you to "Submit URLs that are currently not in the Bing index or that should be reindexed due to recent changes." Does anyone know ...
3
votes
2answers
2k views

Why the number of indexed pages decreased for a “site:” search

Recently I created a website with hundreds of thousands of unique pages. A week ago, Google had indexed about 250,000 pages. It has now decreased to 90k URLs (using a site:domain.com query). What ...
3
votes
4answers
2k views

How can I get a list of all indexed pages for my domain?

We're in the process of migrating an outdated e-commerce cart to Magento. Part of this process will entail configuring proper 301 redirects. I'm aiming to get a list of all indexed pages to throw ...
1
vote
1answer
33 views

Why would I use a robots.txt file? [duplicate]

From what I understand after reading Google's Controlling Crawling and Indexing: The purpose of robots.txt file is to disallow crawling of some URLs, but those can still be indexed (and appear in ...
0
votes
0answers
43 views

Why the amount of 'indexed' images can go down?

I have a site with several thousand of images. All those images included into the sitemap submitted to Google Webmaster Tools. The amount of 'submitted' images is OK, but the amount of 'indexed' is ...
0
votes
3answers
63 views

How to make Google index all sitemap.xml records? [duplicate]

I have a sitemap.xml index fine with 3 XML files in it with around 120 pages for indexing. A year passed and I still have 1/3 of it indexed. All the most important pages for indexing are in 1st ...
2
votes
1answer
20 views

Should I add a site root to the sitemap file?

Is it really necessary to include a root (homedir) of the site to the sitemap? As I can understand the sitemaps main idea - it is not any necessary. Am I right?
10
votes
4answers
658 views

Is there any way to have search engines not index a certain section of a page?

I have Blogger setup with the Blog Archive panel shown on every page so that users can easily get to old posts. The problem is that it lists the title of each page in this panel, meaning that the ...
2
votes
1answer
31 views

Adding Disqus to wordpress effect SEO [duplicate]

I am planning to add Disqus to my WordPress site. Now will my comments will be indexed by the Google as earlier or do I have to add any extra plugins or sitemap for comments.
0
votes
0answers
60 views

How to force Google to index images and webpages? Or I shouldn't bother and just wait a bit more?

I have a web site with a lot of web-pages and images. I created the sitemaps (grouped into single sitemaps index file). I submitted those sitemaps to Google but the indexing process is disappointingly ...
0
votes
0answers
13 views

SEO for Backlinks Using JavaScript on a Third-Party site [duplicate]

We are currently implementing a widget that companies can put on their website. We give the publisher a script tag with the source pointing to a javascript file hosted on a CDN with the code they need ...
0
votes
1answer
57 views

Multiple images on one page: best ranking practices

I have several images related to one object and they all should be placed on one web-page. I'd like to know how do I place those images among the page body and its text. I can not do it manually to ...
0
votes
1answer
39 views

How to find out which images are indexed by Google

I just tried to make request like site:example.com in Images section of Google search. There were about let's say 100 images found (no "Show more results" or any similar was available in the bottom). ...
1
vote
2answers
48 views

Will a search engine index links with different languages if all apart from the main page are missing the path?

Our website www.websitename.com has three languages E.g: www.websitename.com/it www.websitename.com/en www.websitename.com/fr by going to each of those links you will get all the remaining ...
2
votes
3answers
701 views

Why are URLs with my domain name at the end showing up in analytics?

I have a multi-language WordPress site that has been live since the last 3 months and today when I checked Analytics, I saw a lot of weird URLs: ...
0
votes
2answers
54 views

Preventing links with query parameters from being indexed by Google

I manage a mobile version of a desktop site. The mobile site has an mdot subdomain and is served from a different server. As part of recommended best practices by Google, I've included a link on the ...
4
votes
2answers
225 views

Google Webmaster Tools reports fake 404 errors

I have a website where Google Webmaster Tools reports 15,000 links as 404 errors. However, all links return a 200 when I visit them. The problem is, that eventhough I can visit these pages and return ...
3
votes
6answers
148 views

Stopping Google index some web pages I have

I have some web pages that google has indexed. Now I added a robots.txt file to exclude them but should I also add a “noindex” tag and if so then how can I best add this?
0
votes
0answers
14 views

How to prevent Google (and others) from indexing the site under construction? [duplicate]

Recently I faced with the situation that the wrong site pages (with wrong URLs, wrong content) was indexed by Google during the site developing. Should I place robots.txt with User-agent: * Disallow: ...
3
votes
2answers
605 views

Can I force Bing to reindex our site?

Our website is ranking quite well (first page) on Google for quite a lot of keywords. However, our website is not on the first 10 pages of Bing for most of these keywords. I notice our Google ...
1
vote
3answers
189 views

“X-Robots-Tag: noindex” on an HTTP 301 response

I understand that a resource with X-Robots-Tag: noindex forces some search engines, including Google, not to index the resource further. I also understand that an HTTP 301 response causes search ...
1
vote
2answers
34 views

sitemap.xml approach on non-indexed site

On a site that has a robots.txt file that disallows all crawling... User-agent: * Disallow: / ...does it matter what the sitemap.xml content is? Is it better, or does it make a difference at all, ...
1
vote
1answer
82 views

Can Google bots interpret hyphen separated words as a single keyword?

I have a french website which frequently includes the word rendez-vous. But, Google Webmaster Tools content keywords tells me the #1 keyword is rendez which is not what I want. Even worse, the word ...
2
votes
2answers
48 views

Can you create a private website without password protection that would not be indexed?

I'd like to create a "private" website that clients can visit by typing in the provided direct URL (on a business card, for example), but is not password protected and would not be indexed by search ...
1
vote
2answers
89 views

Is it possible for Google to discover a website that is not linked to anywhere? [duplicate]

My colleague claims that he has seen cases where websites were "discovered" by Google without having a link to them anywhere on the web. For him, this means that the only way to not being indexed ...
0
votes
2answers
359 views

How long does Google Webmaster Tools take to index a website?

How much time does Google Webmaster Tools take to index a page? Analytics took around 24 hours to get info from the site, but since this is indexing, I guess it might take a little bit more than that. ...
2
votes
1answer
81 views

How to optimize website for SEO when content is accessed via one search field

We are developing a website (sort of information index for companies) where almost all content is accessed via one search field (similar to Google): you type a search phrase, get results and then can ...
3
votes
3answers
63 views

How to prevent a search engines from indexing a section of a page?

I have many pages with lots of text in it. But I will always have two sections of text and I want to prevent one section from appearing in search results, the other section must be indexed. <p ...
1
vote
2answers
72 views

Search engines that index your site despite a disallow in robots.txt

Recently, WordPress changed their options from "Block search engines" to "Discourage search engines" So that leaves me wondering, that rewording must be that some search engines disregard your ...
3
votes
3answers
195 views

Why is the number of pages on my website indexed by Googlebot decreasing?

I am monitoring the number of pages indexed by Googlebot for one of my websites . I noticed that since last week, the number of pages has dropped by about 60 or so. Now to be fair, I have not added ...
1
vote
3answers
64 views

Using Ajax #! for Google but site is not being crawled any more

We used to have all links in a normal way (thus with parameters?), we changed to AJAX loading cause we installed a music player. Here's an example: Old link: ...
1
vote
1answer
145 views

Provide Search Across Multiple PDFs

I know there are probably many solutions, but what's the easiest and/or most user friendly way to provide search capabilities across PDF files? I'm thinking of a webpage that links to several PDFs and ...
0
votes
0answers
12 views

How do services that make subsites (ie. new subdomains) get those sites indexed by Google and other search enginex? [duplicate]

Services like tumblr, github pages, quora blogs, etc. make new subdomains when a user signs up or makes a site. So the subdomains are like: blogname.tumblr.com , pagename.github.io, ...
0
votes
1answer
29 views

How to use wildcards to remove print pages from search engines?

Our site has pages that are print-friendly, which I would like to remove from search engines. Here's an example: ...
1
vote
2answers
61 views

How to know that my site is getting index/rank by search engine

As per subject, anyone can tell me how to check that my site is getting index/rank by search engine(e.g. google, yahoo)?
2
votes
1answer
41 views

Do sites using YouTube video API get indexed by Google?

Suppose I design a small app that heavily depends on Google YouTube API to dynamically fetch hundreds of YouTube video data. My site will be able to respond to users' requests, and generate several ...
1
vote
3answers
845 views

SEO: Duplicate content caused by pagination/tag/index pages [duplicate]

Possible Duplicate: What is duplicate content and how can I avoid being penalized for it on my site? I read that I should use a NoIndex tag for transitional pages like index, pagination, or ...
1
vote
3answers
106 views

In WordPress, should I “Allow search engines to index this site” during development?

I am going to create a web page, and I will do it online. Should I choose the option: "Allow search engines to index this site." during development, or should this be opened after development ends?