The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

4
votes
3answers
146 views

Can Google Bot index transcript of YouTube hosted video?

We have a number of videos on YouTube, which we embed on our site via iframe/object stuff. Now we want to gain more SEO value by indexing video transcriptions. I have checked one of our video on ...
2
votes
1answer
171 views

What replaces meta keywords if Google doesn't use them anymore? [duplicate]

As a majority of webmasters already know that Google does not use Keywords anymore to help index a website properly. Which is understandable by people exploiting the system to try to gain a better ...
2
votes
1answer
60 views

Robots and Sitemaps

I have some problems regarding indexing. Google indexed so much in the list. Now I wanted to remove everything from my site. If I have disallow all in robots.txt and send my sitemap.xml. Would ...
3
votes
1answer
62 views

Odd/faulty page links being served to Googlebot

Yahoo recently bought Tumblr, where I write fairly long form scientific pieces. I noticed recently that a new script had been added to the end of pages, and it seems to be interacting badly with the ...
0
votes
1answer
76 views

Does Google Webmaster Tools allow me to find out which pages are indexed?

If I'd go to Crawl -> Sitemaps section there will be a list of sitemaps with the number of total pages in each one and the number of indexed pages indicated. However I didn't see any way of finding ...
1
vote
1answer
158 views

Is it a problem for Google if robots.txt blocks URLs in the sitemap?

I had submitted my site's URL to Google Webmaster Tools. I am using OpenCart. I also have robots.txt file which is accessible to Googlebot. Now issue I am facing: Googlebot is blocked from accessing ...
4
votes
2answers
440 views

Does using OpenGraph meta tags help webpages to get indexed better?

I have actually been reading and thinking about adding OpenGraph meta tags to help people who are sharing my blog posts, and different information of my site on Facebook. From reading, that will help ...
0
votes
2answers
27 views

PDF's showing up before relevant pages

When I perform a site:example.com keyword on my site I tend to get a lot of PDF's first and not the relevant pages with the keywords. We are trying to optimize our site for best SEO with Google and am ...
2
votes
2answers
214 views

How to prevent Google from indexing a static web page?

I have a static webpage written in HTML and CSS. I do not want it to be indexed by Google. So I made a robots.txt file in the parent directory and disallowed the URL. I want to know: Is that the ...
2
votes
1answer
54 views

Google not indexing my Mediawiki's jpg files description pages

My website es.wikineos.com has been running for a few years with the MediaWiki Content Management System like the one they use at Wikipedia. Google seems to be indexing my site correctly at a quick ...
1
vote
2answers
93 views

Change Apache +Indexes language

I have a webpage with Index activated. I have this: Is there any way for change language of this, using .htaccess? I've already tried this Directives: AddLanguage pt .pt DefaultLanguage pt-PT ...
1
vote
2answers
69 views

My site indexed with my another domain in google

My site is indexed with my another domains, all of the domain are hosted in same hosting. When I search with site:sample.com it indexed the another domain like this sample.com/www.example.com. How ...
2
votes
1answer
73 views

Google images directing to url with Escaped Fragment

I'm running an ajax website with images and using Google's guidelines for ajax webistes. My site is indexed correctly in Google's web search. But in image search the _escaped_fragment_ appears in the ...
2
votes
4answers
150 views

How long for Google to index all site maps?

We recently uploaded new sitemaps, as the old ones were out of date and we've also upgraded our forum which changed the URLs of a lot of our website (we're 301 redirecting of course). We uploaded the ...
1
vote
3answers
36 views

Older post not indexed, new post indexed right away?

I have a post I created yesterday that was indexed rather quickly by Google. However, I have two other post that I created within the past 4 days that are not indexed and I cannot find a trace of ...
1
vote
2answers
125 views

What is better for SEO robots.txt file or dynamically generated robots.txt URL?

I was relying on our custom WordPress package's dynamically generated robots.txt URL for a few sites but it was not being honoured by Google or Bing (plugin URLs were getting indexed despite the rule ...
2
votes
4answers
273 views

Why doesn't Google remove my noindex and 404 pages?

I've added 404 error codes and no-index meta tag to pages quite some time ago. However, when I check in Google Webmaster Tools, looking at the graph of "removed" pages from their index, I see very low ...
2
votes
2answers
43 views

Would Google penalize me for removing indexed pages?

I'm about to remove a large part of a website in order to replace it by a better alternative which, unfortunately, cannot be mapped to older URIs with URL rewriting. The part of the website I want to ...
2
votes
1answer
94 views

Should paginated sites be included in sitemap?

My website is ad listing for boats, boats' engines, boat rentals, etc (www.mynautics.com). There are ads listed on multiple pages. I have finished (not jet seen on link above) pagination: added ...
0
votes
1answer
47 views

Remove page from Search Result Bunch [duplicate]

When I do a branded search for a website the structure shows like ( see image ). I would love to remove Privacy Policy page or Manipulate the structure I see now ( showing pages I want to ). How I can ...
1
vote
2answers
232 views

How can the number of indexed images go down in Google Webmaster Tools?

I have a site with several thousand images. All those images are included in the sitemap submitted to Google Webmaster Tools. The number of 'submitted' images is OK, but the number of 'indexed' is ...
1
vote
1answer
50 views

Why would I use a robots.txt file? [duplicate]

From what I understand after reading Google's Controlling Crawling and Indexing: The purpose of robots.txt file is to disallow crawling of some URLs, but those can still be indexed (and appear in ...
2
votes
1answer
21 views

Should I add a site root to the sitemap file?

Is it really necessary to include a root (homedir) of the site to the sitemap? As I can understand the sitemaps main idea - it is not any necessary. Am I right?
0
votes
3answers
122 views

How to make Google index all sitemap.xml records? [duplicate]

I have a sitemap.xml index fine with 3 XML files in it with around 120 pages for indexing. A year passed and I still have 1/3 of it indexed. All the most important pages for indexing are in 1st ...
2
votes
1answer
38 views

Adding Disqus to wordpress effect SEO [duplicate]

I am planning to add Disqus to my WordPress site. Now will my comments will be indexed by the Google as earlier or do I have to add any extra plugins or sitemap for comments.
0
votes
0answers
172 views

How to force Google to index images and webpages? Or I shouldn't bother and just wait a bit more?

I have a web site with a lot of web-pages and images. I created the sitemaps (grouped into single sitemaps index file). I submitted those sitemaps to Google but the indexing process is disappointingly ...
0
votes
0answers
15 views

SEO for Backlinks Using JavaScript on a Third-Party site [duplicate]

We are currently implementing a widget that companies can put on their website. We give the publisher a script tag with the source pointing to a javascript file hosted on a CDN with the code they need ...
1
vote
2answers
89 views

Will a search engine index links with different languages if all apart from the main page are missing the path?

Our website www.websitename.com has three languages E.g: www.websitename.com/it www.websitename.com/en www.websitename.com/fr by going to each of those links you will get all the remaining ...
0
votes
1answer
65 views

How to find out which images are indexed by Google

I just tried to make request like site:example.com in Images section of Google search. There were about let's say 100 images found (no "Show more results" or any similar was available in the bottom). ...
0
votes
2answers
185 views

Preventing links with query parameters from being indexed by Google

I manage a mobile version of a desktop site. The mobile site has an mdot subdomain and is served from a different server. As part of recommended best practices by Google, I've included a link on the ...
0
votes
0answers
15 views

How to prevent Google (and others) from indexing the site under construction? [duplicate]

Recently I faced with the situation that the wrong site pages (with wrong URLs, wrong content) was indexed by Google during the site developing. Should I place robots.txt with User-agent: * Disallow: ...
2
votes
3answers
403 views

Why is Google Webmaster Tools account showing fewer indexed pages than a site: search?

When I have check my website index pages it is showing only 252 pages are indexed but when I checked through Google Search by typing site:http://www.example.com then is showing more then 900 pages are ...
1
vote
1answer
203 views

Can Google bots interpret hyphen separated words as a single keyword?

I have a french website which frequently includes the word rendez-vous. But, Google Webmaster Tools content keywords tells me the #1 keyword is rendez which is not what I want. Even worse, the word ...
1
vote
2answers
43 views

sitemap.xml approach on non-indexed site

On a site that has a robots.txt file that disallows all crawling... User-agent: * Disallow: / ...does it matter what the sitemap.xml content is? Is it better, or does it make a difference at all, ...
0
votes
1answer
64 views

Multiple images on one page: best ranking practices

I have several images related to one object and they all should be placed on one web-page. I'd like to know how do I place those images among the page body and its text. I can not do it manually to ...
2
votes
2answers
77 views

Can you create a private website without password protection that would not be indexed?

I'd like to create a "private" website that clients can visit by typing in the provided direct URL (on a business card, for example), but is not password protected and would not be indexed by search ...
0
votes
2answers
2k views

How long does Google Webmaster Tools take to index a website?

How much time does Google Webmaster Tools take to index a page? Analytics took around 24 hours to get info from the site, but since this is indexing, I guess it might take a little bit more than that. ...
1
vote
2answers
118 views

Search engines that index your site despite a disallow in robots.txt

Recently, WordPress changed their options from "Block search engines" to "Discourage search engines" So that leaves me wondering, that rewording must be that some search engines disregard your ...
0
votes
0answers
12 views

How do services that make subsites (ie. new subdomains) get those sites indexed by Google and other search enginex? [duplicate]

Services like tumblr, github pages, quora blogs, etc. make new subdomains when a user signs up or makes a site. So the subdomains are like: blogname.tumblr.com , pagename.github.io, ...
0
votes
1answer
46 views

How to use wildcards to remove print pages from search engines?

Our site has pages that are print-friendly, which I would like to remove from search engines. Here's an example: ...
2
votes
1answer
74 views

Do sites using YouTube video API get indexed by Google?

Suppose I design a small app that heavily depends on Google YouTube API to dynamically fetch hundreds of YouTube video data. My site will be able to respond to users' requests, and generate several ...
1
vote
3answers
243 views

In WordPress, should I “Allow search engines to index this site” during development?

I am going to create a web page, and I will do it online. Should I choose the option: "Allow search engines to index this site." during development, or should this be opened after development ends?
1
vote
1answer
88 views

Google showing meta descriptions from other pages in the SERPs [closed]

Recently I added some content to my website and submitted a sitemap files to Google. Now that Google has indexed those pages, I discovered that some of words and sentences that are listed in Google ...
2
votes
2answers
536 views

301 redirect from HTTP to HTTPS - how to be sure Google is fetching the correct information?

I'm hoping somebody might be able to provide a bit of advice on an issue I am having. I have one site where we implemented a 301 redirect on the homepage from HTTP to HTTPS. We have links on the ...
3
votes
3answers
76 views

How to prevent a search engines from indexing a section of a page?

I have many pages with lots of text in it. But I will always have two sections of text and I want to prevent one section from appearing in search results, the other section must be indexed. <p ...
0
votes
0answers
17 views

Getting rank for keywords that I don't want to appear on my website [duplicate]

One of my products has two names. One of them is what I consider correct and thus it is what I want to appear on my website. The other name is incorrect for me, so I would like to avoid it. But I know ...
5
votes
1answer
632 views

Can you use googleon and googleoff comments to prevent Googlebot from indexing part of a page?

I've seen code like for preventing Google from indexing part of a page: <p>This is a paragraph that will be indexed by Google.</p> <!--googleoff: index--> <p>This is a ...
0
votes
1answer
74 views

Search engine bots accessing strange URLs

We have ELMAH enabled on our site and get errors whenever a Page Not Found error is triggered on the website. We have recently redesigned a new website and so we understand that search engine ...
1
vote
1answer
84 views

Will Google Scholar index the papers on my website?

I have just requested that Google Scholar collect the papers from my personal web site: http://cs.uic.edu/~asmirnov/publications.html I was wondering if I did everything right: I submitted a ...
1
vote
1answer
224 views

Google indexing less images after switching to CDN

After switching to a CDN I noticed that my indexed images went down. I have close to 1000 images on the site with correct tags, alt tags and all of that. Right now we have about 1000 images with only ...