The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

2
votes
1answer
25 views

Should I add a site root to the sitemap file?

Is it really necessary to include a root (homedir) of the site to the sitemap? As I can understand the sitemaps main idea - it is not any necessary. Am I right?
2
votes
2answers
617 views

301 redirect from HTTP to HTTPS - how to be sure Google is fetching the correct information?

I'm hoping somebody might be able to provide a bit of advice on an issue I am having. I have one site where we implemented a 301 redirect on the homepage from HTTP to HTTPS. We have links on the ...
2
votes
1answer
60 views

Is this considered to be “Internal Near-Duplicates”?

Some people generate the same pages with a slight variation in keywords, title, country name, region name, etc... This is typically considered to be "Internal Near-Duplicates." I have seen a website ...
2
votes
2answers
72 views

Should I have link rel=next & prev on URLs which have query variables?

For example, I have link rel prev & next set up on these pages of products: site.com?page=2 site.com?page=3 (this is my preferred structure by the way and I'm trying to get all the ugly URLs ...
2
votes
1answer
152 views

JavaScript loaded external content SEO

I wonder what is the best way to have Javascript loaded content indexed by search engines. I know that search engines don't execute Javascript, but I am thinking more of an progressive enchantment. I ...
2
votes
1answer
96 views

Why is Google indexing all these other websites?

I run a web hosting company and I have noticed something strange about the way my website and the other websites that I host are indexed in Google. For some reason, other websites that I am hosting ...
2
votes
1answer
143 views

Lasting discrepancy between the site command and indexed pages in Google Webmaster

I have recently uploaded a blog on blogger. The pages of my blog are accessible for crawling and indexing and I can see that some crawling has started two weeks ago. I have noticed that the ...
2
votes
1answer
262 views

301 redirect to different page on different domain?

I want to make a 301 redirect to a different page on a different domain. The page is on the same topic, but is different content. Also, the traffic to the original page comes from the alt text on an ...
2
votes
1answer
349 views

how to set 301 redirect in wordpress .htacces file

In continuation of my previously asked question preserve-search-engine-index-while-shifting-to-new-domain. The migration is being done in the word-press and we will have same server with same IP.Since ...
2
votes
0answers
39 views

Webpages being de-indexed seemingly for no reason [duplicate]

Last Wednesday my site had a ton of its paged de-indexed by Google and it's caused a drop of over 60% in overall site traffic :(... One of the pages used to rank first page #1-3 and now it doesn't ...
2
votes
0answers
54 views

Indexing several editions of a same event [closed]

We have a website presenting sport events, mostly annual. Each URL contains the event's year and name. E.g: /marathon/my-event-2014 /marathon/my-event-2015 /marathon/my-event-2016 (the reason why ...
2
votes
1answer
192 views

Website not fetched by Bingbot: Unexpected Error

My website has been online for a couple years. It's on the first result for Google but it doesn't seem to be indexed by Bing. I tried to fetch it with bing in their webmaster tools and it always ...
2
votes
0answers
42 views

How come a site is indexed but not indexed? [closed]

An example URL: islamqa.info/ar The site is indexed in Google Webmaster Tools as per this image But When I use google site: operator, I get Your search - site:islamqa.info/ar - did not match any ...
2
votes
2answers
70 views

Google indexing pages very slowly [duplicate]

Is there anything I can do to speed up the time it takes to index my pages? It's currently indexing them on it's own time I believe which is every 2 - 3 days and when working in music and media I need ...
2
votes
1answer
47 views

Adding Disqus to wordpress effect SEO [duplicate]

I am planning to add Disqus to my WordPress site. Now will my comments will be indexed by the Google as earlier or do I have to add any extra plugins or sitemap for comments.
2
votes
1answer
108 views

google removed links from the index [duplicate]

I asked google to crawl a site through webmaster tool and include it to the index. How actually it was done: Firstly, i picked some urls manually. Approx. after half of a day those pages were ...
2
votes
1answer
1k views

How to get google and bing to index original image, not thumbnail?

I've read this post Make google index the actual image not the thumbnail but my case is a little different. I have over a thousand images, in many different directories, with many different names, ...
2
votes
0answers
770 views

google webmaster showing 6 pages submitted 0 indexed, yet i can see them all there when i search in google? [closed]

I have a small 'brochure' type site with 6 pages, i can see them all the pages showing up in google when i search for my site. But in webmaster tools under the sitemaps section it says 6 submitted, ...
1
vote
2answers
3k views

Why are new pages not being indexed and old pages stay in the index?

I currently have a site that was recently restructured, causing much of its content to be reposted, creating new URL's for each page. To avoid duplicates, all of the existing pages were added to the ...
1
vote
2answers
368 views

Why won't title attributes get indexed in Google?

When I search for Ride On + my site's name, I see that it's indexed. But when I search for Green Horse + my site's name, I don't see my site appearing in the results anywhere! Here's my code: ...
1
vote
3answers
848 views

How to suppress PHPSESSID in URL for Googlebot?

I use cookie based sessions, and they work for normal interaction with our site. However, when Googlebot comes crawling our PHP framework, Yii, needs to append ?PHPSESSID to each URL, which doesn't ...
1
vote
2answers
89 views

Does Google provide different Index status for HTTP and HTTPS?

Will Google provide different index statuses for HTTP and HTTPS? Examples: http://www.example.com and https://www.example.com Or it will provide same results for both? If it doesn't provide the ...
1
vote
2answers
383 views

Preventing links with query parameters from being indexed by Google

I manage a mobile version of a desktop site. The mobile site has an mdot subdomain and is served from a different server. As part of recommended best practices by Google, I've included a link on the ...
1
vote
3answers
203 views

Is Google still giving weightage for old domain, i.e at least 6 month old?

Is Google still giving weightage for old domain, i.e at least 6 months old? I mean I have the best content which is useful for users. Do I still have to wait for my domain name to be at least 6 ...
1
vote
3answers
922 views

SEO: Duplicate content caused by pagination/tag/index pages [duplicate]

Possible Duplicate: What is duplicate content and how can I avoid being penalized for it on my site? I read that I should use a NoIndex tag for transitional pages like index, pagination, or ...
1
vote
3answers
87 views

How can pages which aren't indexed be reported as landing pages in Google Analytics?

In Google Analytics I have thousands of landing pages reported, however on checking some of them they aren't indexed in Google, this is expected as the have robots NOINDEX tag in the source code. So ...
1
vote
2answers
51 views

sitemap.xml approach on non-indexed site

On a site that has a robots.txt file that disallows all crawling... User-agent: * Disallow: / ...does it matter what the sitemap.xml content is? Is it better, or does it make a difference at all, ...
1
vote
3answers
365 views

In WordPress, should I “Allow search engines to index this site” during development?

I am going to create a web page, and I will do it online. Should I choose the option: "Allow search engines to index this site." during development, or should this be opened after development ends?
1
vote
3answers
603 views

Why is Google not indexing my forum?

I have this web site that as you can see on the top right has is a "Forums" button that links to my forums. My problem is that if, for instance, I make a Google search "site:heliumscraper.com ...
1
vote
1answer
271 views

Change to www from naked domain impact on seo

I have set up my website from the beginning to be used without the www, ie 'naked', with the following command at .htaccess and everything is working fine. RewriteCond %{HTTP_HOST} ...
1
vote
2answers
122 views

Request Removal of naked domain from Google Index

I have a site which was temporarily available at both example.com and www.example.com. All traffic to example.com is now redirected to www.example.com, however during the brief period that the site ...
1
vote
2answers
127 views

Is it possible for Google to discover a website that is not linked to anywhere? [duplicate]

My colleague claims that he has seen cases where websites were "discovered" by Google without having a link to them anywhere on the web. For him, this means that the only way to not being indexed ...
1
vote
1answer
149 views

How to disallow indexing but allow crawling?

In the front page of my website, I have some previews to articles (with a small introduction to them) that link to the full articles. I want to disallow the front page to prevent duplicate content. ...
1
vote
2answers
242 views

Google is not indexing my pages [duplicate]

I just typed a post title from a few days ago into Google with "quotes" around it and nothing is showing up. Does Google hate me? I am doing nothing but white hat marketing and even took down the ...
1
vote
3answers
1k views

How to prevent Google from finding my admin index page?

I am running a website but for some days i stopped it and put the under-construction page because the Index of admin page is visible to the outside world through the Google search. One of my friend ...
1
vote
2answers
1k views

Huge drop in indexed pages [duplicate]

Possible Duplicate: Why the # of indexed pages got dicreased? My site's indexed pages drop every now and then. It suddenly drops from ~800.000 to ~20.000 pages, along with a huge drop in ...
1
vote
3answers
982 views

My site is indexed in Google yet does not show in the SERPs

Please someone solve this mystery that has been plaguing me for months! All pages have been cached by Google recently yet still will not show up in a search. I'm guessing it's being penalized? How ...
1
vote
3answers
52 views

Preserving search engine rankings when old domain name is lost

We have a client with the unfortunate situation of losing access to their current domain name "A". We've just finished finished setting their website up on domain "B". Both websites on "A" and "B" ...
1
vote
4answers
51 views

How to remove a website completely from search engine indexes except the home page?

I want to de-index all the pages of my website except home page. This is because it is an exact match domain (EMD) and I'm getting traffic on website just because of Domain name. I want to restart ...
1
vote
2answers
174 views

Allow/Make search engine to index images hosted on third party

I have my personal blog website and using Dropbox to host images (through public folders) and use them in my blog website. Is their any way to index those images in search engine like Google. I have ...
1
vote
2answers
187 views

Change Apache +Indexes language

I have a webpage with Index activated. I have this: Is there any way for change language of this, using .htaccess? I've already tried this Directives: AddLanguage pt .pt DefaultLanguage pt-PT ...
1
vote
2answers
131 views

Search engines that index your site despite a disallow in robots.txt

Recently, WordPress changed their options from "Block search engines" to "Discourage search engines" So that leaves me wondering, that rewording must be that some search engines disregard your ...
1
vote
2answers
170 views

Google references subfolders

Last week I launched a website and created a robots.txt: User-agent: * Disallow: Sitemap: http://mywebsite.tld/sitemap_robots.xml Now I've checked the indexed pages (Google -> ...
1
vote
2answers
113 views

I don't think my site is being detected/crawled properly/having backlinks, and it's ruining SEO [closed]

This is really frustrating. I'm setting up a computer repairs business called Darley Tech. I have listed my site on many online directories to encourage backlinks. I have relevant and useful ...
1
vote
1answer
116 views

How do search engines index XML-based websites?

I'm talking about the kind that transforms XML into (X)HTML on the client side. We all know that search engines use semantics in HTML (headings, links) to rank your website. So if you don't already ...
1
vote
2answers
1k views

Does searchbots index content in iframe [duplicate]

Possible Duplicate: Do we still need to avoid using frame/iframe for good SEO? I have a html page that has a map of a country with lots of dots indicating location of companies through out ...
1
vote
1answer
459 views

When will iframe content be indexed as part of the surrounding page?

Our system provides a web front-end. A potential client would like to set up his own portal, and place our pages within his own pages, using iframes. He'd also like Google to index the joined content. ...
1
vote
2answers
61 views

How to know that my site is getting index/rank by search engine

As per subject, anyone can tell me how to check that my site is getting index/rank by search engine(e.g. google, yahoo)?
1
vote
1answer
34 views

How to stop beta websites indexing in Google Search? [duplicate]

I want stop my beta.example.com being indexed by search engines, because it can generate duplication issue.
1
vote
2answers
258 views

Google is indexing pages with a “noindex” robots meta tag

I have come across a very annoying problem. I have several pages that shouldn't be indexed, as they are basically pop-up pages and "thanks for signing up" pages. I have set them up with the robots ...