The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

2
votes
2answers
308 views

301 redirect from HTTP to HTTPS - how to be sure Google is fetching the correct information?

I'm hoping somebody might be able to provide a bit of advice on an issue I am having. I have one site where we implemented a 301 redirect on the homepage from HTTP to HTTPS. We have links on the ...
2
votes
1answer
55 views

Is this considered to be “Internal Near-Duplicates”?

Some people generate the same pages with a slight variation in keywords, title, country name, region name, etc... This is typically considered to be "Internal Near-Duplicates." I have seen a website ...
2
votes
2answers
63 views

Should I have link rel=next & prev on URLs which have query variables?

For example, I have link rel prev & next set up on these pages of products: site.com?page=2 site.com?page=3 (this is my preferred structure by the way and I'm trying to get all the ugly URLs ...
2
votes
1answer
123 views

JavaScript loaded external content SEO

I wonder what is the best way to have Javascript loaded content indexed by search engines. I know that search engines don't execute Javascript, but I am thinking more of an progressive enchantment. I ...
2
votes
1answer
257 views

What does “all” mean in meta robots tag?

Several websites have the following meta tag aimed at search engines like Google, Bing, etc.: <meta name="robots" content="all" /> What does it do?
2
votes
2answers
201 views

How to have google index a login protected url?

For example, my site: http://abcde.foobar.com is protected by a "single sign on" login page hosted at http://sso.foobar.com, so when a user visits "abcde", they get redirected to the "sso" login page ...
2
votes
1answer
91 views

Why is Google indexing all these other websites?

I run a web hosting company and I have noticed something strange about the way my website and the other websites that I host are indexed in Google. For some reason, other websites that I am hosting ...
2
votes
1answer
112 views

Lasting discrepancy between the site command and indexed pages in Google Webmaster

I have recently uploaded a blog on blogger. The pages of my blog are accessible for crawling and indexing and I can see that some crawling has started two weeks ago. I have noticed that the ...
2
votes
1answer
249 views

301 redirect to different page on different domain?

I want to make a 301 redirect to a different page on a different domain. The page is on the same topic, but is different content. Also, the traffic to the original page comes from the alt text on an ...
2
votes
1answer
336 views

how to set 301 redirect in wordpress .htacces file

In continuation of my previously asked question preserve-search-engine-index-while-shifting-to-new-domain. The migration is being done in the word-press and we will have same server with same IP.Since ...
2
votes
1answer
65 views

Preserve search engine rankings while shifting to new domain name

We have to shift our web-site to a new domain due to some unavoidable circumstances. The portal has been up and running there since 2009. It has good index in various search engines and we are ...
2
votes
1answer
31 views

Adding Disqus to wordpress effect SEO [duplicate]

I am planning to add Disqus to my WordPress site. Now will my comments will be indexed by the Google as earlier or do I have to add any extra plugins or sitemap for comments.
2
votes
1answer
97 views

google removed links from the index [duplicate]

I asked google to crawl a site through webmaster tool and include it to the index. How actually it was done: Firstly, i picked some urls manually. Approx. after half of a day those pages were ...
2
votes
1answer
635 views

How to get google and bing to index original image, not thumbnail?

I've read this post Make google index the actual image not the thumbnail but my case is a little different. I have over a thousand images, in many different directories, with many different names, ...
2
votes
0answers
623 views

google webmaster showing 6 pages submitted 0 indexed, yet i can see them all there when i search in google? [closed]

I have a small 'brochure' type site with 6 pages, i can see them all the pages showing up in google when i search for my site. But in webmaster tools under the sitemaps section it says 6 submitted, ...
1
vote
2answers
352 views

Why won't title attributes get indexed in Google?

When I search for Ride On + my site's name, I see that it's indexed. But when I search for Green Horse + my site's name, I don't see my site appearing in the results anywhere! Here's my code: ...
1
vote
2answers
2k views

Why are new pages not being indexed and old pages stay in the index?

I currently have a site that was recently restructured, causing much of its content to be reposted, creating new URL's for each page. To avoid duplicates, all of the existing pages were added to the ...
1
vote
3answers
703 views

How to suppress PHPSESSID in URL for Googlebot?

I use cookie based sessions, and they work for normal interaction with our site. However, when Googlebot comes crawling our PHP framework, Yii, needs to append ?PHPSESSID to each URL, which doesn't ...
1
vote
3answers
188 views

Is Google still giving weightage for old domain, i.e at least 6 month old?

Is Google still giving weightage for old domain, i.e at least 6 months old? I mean I have the best content which is useful for users. Do I still have to wait for my domain name to be at least 6 ...
1
vote
2answers
34 views

sitemap.xml approach on non-indexed site

On a site that has a robots.txt file that disallows all crawling... User-agent: * Disallow: / ...does it matter what the sitemap.xml content is? Is it better, or does it make a difference at all, ...
1
vote
3answers
110 views

In WordPress, should I “Allow search engines to index this site” during development?

I am going to create a web page, and I will do it online. Should I choose the option: "Allow search engines to index this site." during development, or should this be opened after development ends?
1
vote
3answers
409 views

Why is Google not indexing my forum?

I have this web site that as you can see on the top right has is a "Forums" button that links to my forums. My problem is that if, for instance, I make a Google search "site:heliumscraper.com ...
1
vote
2answers
89 views

Is it possible for Google to discover a website that is not linked to anywhere? [duplicate]

My colleague claims that he has seen cases where websites were "discovered" by Google without having a link to them anywhere on the web. For him, this means that the only way to not being indexed ...
1
vote
1answer
138 views

How to disallow indexing but allow crawling?

In the front page of my website, I have some previews to articles (with a small introduction to them) that link to the full articles. I want to disallow the front page to prevent duplicate content. ...
1
vote
2answers
235 views

Google is not indexing my pages [duplicate]

I just typed a post title from a few days ago into Google with "quotes" around it and nothing is showing up. Does Google hate me? I am doing nothing but white hat marketing and even took down the ...
1
vote
3answers
897 views

How to prevent Google from finding my admin index page?

I am running a website but for some days i stopped it and put the under-construction page because the Index of admin page is visible to the outside world through the Google search. One of my friend ...
1
vote
2answers
817 views

Huge drop in indexed pages [duplicate]

Possible Duplicate: Why the # of indexed pages got dicreased? My site's indexed pages drop every now and then. It suddenly drops from ~800.000 to ~20.000 pages, along with a huge drop in ...
1
vote
1answer
705 views

Google is not indexing URLs in my XML SiteMap?

I have used multiple sitemap.xml for my product pages and my category pages and problem is google only not index my whole site map's link. /sitemap_main.xml -- URLs submitted:114 // ...
1
vote
3answers
617 views

My site is indexed in Google yet does not show in the SERPs

Please someone solve this mystery that has been plaguing me for months! All pages have been cached by Google recently yet still will not show up in a search. I'm guessing it's being penalized? How ...
1
vote
1answer
18 views

Older post not indexed, new post indexed right away?

I have a post I created yesterday that was indexed rather quickly by Google. However, I have two other post that I created within the past 4 days that are not indexed and I cannot find a trace of ...
1
vote
2answers
72 views

Search engines that index your site despite a disallow in robots.txt

Recently, WordPress changed their options from "Block search engines" to "Discourage search engines" So that leaves me wondering, that rewording must be that some search engines disregard your ...
1
vote
3answers
272 views

Google crawl speed — how fast can it go?

I have a huge website with 5 million pages. Currently Google indexes about 10,000 pages per day. This is very slow, I still have lots of pages that I can't get indexed. Does anyone know what is the ...
1
vote
2answers
114 views

Google references subfolders

Last week I launched a website and created a robots.txt: User-agent: * Disallow: Sitemap: http://mywebsite.tld/sitemap_robots.xml Now I've checked the indexed pages (Google -> ...
1
vote
2answers
112 views

I don't think my site is being detected/crawled properly/having backlinks, and it's ruining SEO [closed]

This is really frustrating. I'm setting up a computer repairs business called Darley Tech. I have listed my site on many online directories to encourage backlinks. I have relevant and useful ...
1
vote
1answer
90 views

How do search engines index XML-based websites?

I'm talking about the kind that transforms XML into (X)HTML on the client side. We all know that search engines use semantics in HTML (headings, links) to rank your website. So if you don't already ...
1
vote
2answers
1k views

Does searchbots index content in iframe [duplicate]

Possible Duplicate: Do we still need to avoid using frame/iframe for good SEO? I have a html page that has a map of a country with lots of dots indicating location of companies through out ...
1
vote
1answer
423 views

When will iframe content be indexed as part of the surrounding page?

Our system provides a web front-end. A potential client would like to set up his own portal, and place our pages within his own pages, using iframes. He'd also like Google to index the joined content. ...
1
vote
2answers
61 views

How to know that my site is getting index/rank by search engine

As per subject, anyone can tell me how to check that my site is getting index/rank by search engine(e.g. google, yahoo)?
1
vote
3answers
845 views

SEO: Duplicate content caused by pagination/tag/index pages [duplicate]

Possible Duplicate: What is duplicate content and how can I avoid being penalized for it on my site? I read that I should use a NoIndex tag for transitional pages like index, pagination, or ...
1
vote
2answers
56 views

What is better for SEO robots.txt file or dynamically generated robots.txt URL?

I was relying on our custom WordPress package's dynamically generated robots.txt URL for a few sites but it was not being honoured by Google or Bing (plugin URLs were getting indexed despite the rule ...
1
vote
2answers
48 views

Will a search engine index links with different languages if all apart from the main page are missing the path?

Our website www.websitename.com has three languages E.g: www.websitename.com/it www.websitename.com/en www.websitename.com/fr by going to each of those links you will get all the remaining ...
1
vote
1answer
89 views

Google indexing less images after switching to CDN

After switching to a CDN I noticed that my indexed images went down. I have close to 1000 images on the site with correct tags, alt tags and all of that. Right now we have about 1000 images with only ...
1
vote
1answer
122 views

Will Google index a PHP header redirect?

I have a new domain which has an index.php file. Inside this file, I get user's IP, save it and redirect to another page on another domain. So there is no output, only header info. Will Google index ...
1
vote
3answers
190 views

“X-Robots-Tag: noindex” on an HTTP 301 response

I understand that a resource with X-Robots-Tag: noindex forces some search engines, including Google, not to index the resource further. I also understand that an HTTP 301 response causes search ...
1
vote
1answer
37 views

Prohibit search engines before going live

I want to prohibit search engines to index my web site before going live with it. If I simple do a robots.txt with: User-agent: * Disallow: / Would that cause any issues later when I decide to ...
1
vote
1answer
40 views

What's the best way to handle multiple sites on a shared server?

I'm on a shared server (via LunarPages), and I also host a few low-impact sites for a few small businesses. I recently had a problem (blocked crawlers by messing with the internal settings) that made ...
1
vote
1answer
138 views

Index manager in cpanel. Do contents still get indexed with “No Indexing”?

Simple question. A folder, lets say for example abc.com/images/ Is being displayed on google as "index of", which I don't like. The contents of this folder are important, and it is important that ...
1
vote
2answers
135 views

Need advice, previous parked domain not indexing on Google

I originally bought the domain (www.iconicphotos.co.uk) a while ago, I then decided to try and sell it on Sedo. The domain was up for sale for a few months before I noticed that the ads being pulled ...
1
vote
2answers
112 views

What should be done after renaming the urls of my website?

One month ago, I updated all the product URLs on my site which were separated by _ sign to be separated by - sign. Example: .com/Calipers/Insize_1108 now looks like .com/Calipers/Insize-1108 ...
1
vote
2answers
74 views

Blog is not indexing in google search [duplicate]

I have a blog with url http://webzpedia.blogspot.in which is about 2 years old. In early days there is 200+ pageviews coming from the google search itself. But from last 4-5 months, google stopped ...