The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.
3
votes
2answers
112 views
Can I force Bing to reindex our site?
Our website is ranking quite well (first page) on Google for quite a lot of keywords.
However, our website is not on the first 10 pages of Bing for most of these keywords.
I notice our Google ...
3
votes
1answer
387 views
Webmaster Tools show the “Total Indexed” number to be zero
I recently switched my domain from yannbane.blogspot.com to www.yannbane.com, and added my new domain to my Webmaster Tools account. After a few days, I went there and checked the data, and I was a ...
3
votes
2answers
193 views
Best approach to have Google index content primarily generated by Javascript
I'm developing an app where customers can drop in a Javascript tag onto their website, and it will generate content. What is the best approach to have Google index this content and associate it with ...
3
votes
2answers
55 views
Using .htaccess for proper indexing/SEO of timthumb images
I don't know a whole lot about the intricacies of SEO so I was wondering if someone here could provide some insight to this problem.
When you use the php script timthumb on a website, it means images ...
3
votes
2answers
213 views
Google De-Index many pages at once?
On one of our websites, Google has been indexing something it wasn't supposed to. We fixed the problem so it shouldn't happen anymore, but are interested in requesting that Google de-index these ...
2
votes
5answers
4k views
How to protect PDF file from indexing?
I have link to PDF document on a public web-page. How to prevent search engines to index this link and PDF document. The only idea that came to my mind is to use captcha. However I wounder if there ...
2
votes
2answers
65 views
New domain and submission to search engines
I have registered a new domain with a hosting company. They offer the feature that for each new domain there is an associated placeholder page. Actually it is a "Site not configured page" with some ...
2
votes
2answers
1k views
Why the number of indexed pages got decreased?
Recently I have created a website with hundreds of thousands of unique pages. A week before Google indexed about 250,000 pages but it has decreased to 90k urls today (site:domain.com). What should I ...
2
votes
3answers
73 views
Multiple site pages not accesible via main site nav- SEO implications?
I run a site that has some of the site pages accessible through the site's main navigation. Then, there are 50+ "state" pages that are accessible to a user if they click on a specific state on a ...
2
votes
3answers
165 views
Why are URLs with my domain name at the end showing up in analytics?
I have a multi-language WordPress site that has been live since the last 3 months and today when I checked Analytics, I saw a lot of weird URLs:
...
2
votes
2answers
97 views
How to explain visitors that we don't control Google's results?
I have a message boards. Once in a while, some people contact us to remove anything related to them. We comply and delete all the posts and all traces. Some of those visitors still complain that they ...
2
votes
2answers
361 views
What does Google do with indexed pages returning 403?
I guess that Google removes already indexed pages that are now returning the HTTP error 403.
Unfortunately I can't find any definitive statement on that matter. Do you know the answer?
2
votes
2answers
111 views
This address should never have been indexed, how can I properly remove it?
I have a couple of subdomains on my website that I use for various purposes and I don't want/need them to be indexed by search engines. From the very beginning, since I created them, I added a ...
2
votes
3answers
67 views
Is there a legal way to serve data-dump content without incurring search engine penalties?
I have a games site and I'm writing an API that will pull relevant Q&A from my copy of the SE data dump. I will abide by all licensing rules.
That said, I'm hesitant to do this because Google ...
2
votes
2answers
142 views
Will this sitemap get me de indexed from Google?
My site's URL (web address) is: http://quantlabs.net/private/sitemap.xml
Description (including timeline of any changes made):
Will this sitemap get me de-indexed from Google?
My new site map just ...
2
votes
1answer
183 views
Indexing a multilingual website
I am trying to create a multilingual website using the Django framework, all default content is English. I have added a native translation (Dutch).
https://mydomain.com/ redirects to the user request ...
2
votes
3answers
970 views
Finding Google's indexed pages
How do I find out how many pages Google has indexed on my website? I know I can just Google site:http://foo.com, but I would like to record the data and not have to do it by hand. Is there an API for ...
2
votes
3answers
250 views
After adding *.xls to robots.txt how long will the results continue to show up in google
Is there an estimated amount of time before the document will not appear in google results?
We have a public records document. One person raised a concern when they saw their "PUBLIC INFORMATION" on ...
2
votes
2answers
105 views
problem showing my website correctly in search engines
I have a website which i have indexed on google for example (like 15 days ago).
some of my pages pass arguments like:
http://www.bla.com/products.php?pro=bla&page=view
suddently i saw that ...
2
votes
1answer
219 views
Should I strategically use NoFollow on internal links to make our indexing crawl more efficient?
We have a well designed internal linking system that makes certain no page is more than four pages deep, and the indexing process has gone well for us.
However, in addition to the hierarchical page ...
2
votes
3answers
127 views
Site not indexed by Google [duplicate]
I typed the following on Google: (1) site: uniquevolve.com (2) site: uniquevolve.com.au
Only (2) gets indexed. Is this normal?
The strange thing is, my Website is actually hosted on the server with ...
2
votes
2answers
143 views
Is it better to burn old domain names and 301 to a new one for domains that experienced a high number of errors?
As discussed in this topic, several sites were down due to a server issue for about a month. I have slowly watched some of the more popular sites gain some traffic. I did say slowly.
I have also ...
2
votes
1answer
79 views
Are the following assumptions about indexing and ranking correct?
Are the following statements true or false:
If a page is crawled by Google, it automatically gets into the index (unless explicitly blocked by robots.txt)
An indexed page always gets a ranking (high ...
2
votes
2answers
87 views
Prevent crawler that doesn't honoring robots.txt
I have some problem, when I try to write robots.txt for my site ...
I find some issues by search on Google, and tell me about honor and not honoring robots.txt, how I can prevent it, can I perform it ...
2
votes
1answer
66 views
How to optimize website for SEO when content is accessed via one search field
We are developing a website (sort of information index for companies) where almost all content is accessed via one search field (similar to Google): you type a search phrase, get results and then can ...
2
votes
2answers
191 views
Should I notify 'under construction' websites to crawlers? If yes how?
I am currently developing a website which is going to take some time to finish. I need to move some 'stuff' to production frequently, while maintaining a under construction status. My front page will ...
2
votes
1answer
197 views
Why do Google FreshBot crawled and indexed pages disappear from SERPs? Will they come back?
Sometimes a page on our site will show up in the Google SERPs that was previously not indexed (yet) due to a news story or blog posting on another site that points to it.
From what I understand, the ...
2
votes
1answer
39 views
What does “all” mean in meta robots tag?
Several websites have the following meta tag aimed at search engines like Google, Bing, etc.:
<meta name="robots" content="all" />
What does it do?
2
votes
2answers
91 views
How to have google index a login protected url?
For example, my site:
http://abcde.foobar.com is protected by a "single sign on" login page hosted at http://sso.foobar.com, so when a user visits "abcde", they get redirected to the "sso" login page ...
2
votes
1answer
84 views
Why is Google indexing all these other websites?
I run a web hosting company and I have noticed something strange about the way my website and the other websites that I host are indexed in Google. For some reason, other websites that I am hosting ...
2
votes
1answer
79 views
Lasting discrepancy between the site command and indexed pages in Google Webmaster
I have recently uploaded a blog on blogger. The pages of my blog are accessible for crawling and indexing and I can see that some crawling has started two weeks ago.
I have noticed that the ...
2
votes
1answer
188 views
301 redirect to different page on different domain?
I want to make a 301 redirect to a different page on a different domain. The page is on the same topic, but is different content.
Also, the traffic to the original page comes from the alt text on an ...
2
votes
1answer
320 views
how to set 301 redirect in wordpress .htacces file
In continuation of my previously asked question preserve-search-engine-index-while-shifting-to-new-domain.
The migration is being done in the word-press and we will have same server with same IP.Since ...
2
votes
1answer
56 views
Preserve Search engine index while shifting to new Domain
I am not a SEO guy so not sure how relevant my question is.
We have to shift our web-site to a new domain due to some unavoidable circumstances but since the portal is up and running there from 2009 ...
2
votes
1answer
62 views
google removed links from the index [duplicate]
I asked google to crawl a site through webmaster tool and include it to the index.
How actually it was done:
Firstly, i picked some urls manually. Approx. after half of a day those pages were ...
2
votes
1answer
272 views
How to get google and bing to index original image, not thumbnail?
I've read this post Make google index the actual image not the thumbnail but my case is a little different.
I have over a thousand images, in many different directories, with many different names, ...
1
vote
2answers
313 views
Why won't title attributes get indexed in Google?
When I search for Ride On + my site's name, I see that it's indexed.
But when I search for Green Horse + my site's name, I don't see my site appearing in the results anywhere!
Here's my code:
...
1
vote
3answers
528 views
How to suppress PHPSESSID in URL for Googlebot?
I use cookie based sessions, and they work for normal interaction with our site. However, when Googlebot comes crawling our PHP framework, Yii, needs to append ?PHPSESSID to each URL, which doesn't ...
1
vote
2answers
1k views
Why are new pages not being indexed and old pages stay in the index?
I currently have a site that was recently restructured, causing much of its content to be reposted, creating new URL's for each page.
To avoid duplicates, all of the existing pages were added to the ...
1
vote
3answers
140 views
Is google still giving weightage for old domain .. i.e atleast 6 month old.?
Is google still giving weightage for old domain, i.e at least 6 months old?
I mean I have the best content which is useful for users.
Do I still have to wait for my domain name to be at least 6 ...
1
vote
1answer
116 views
How to disallow indexing but allow crawling?
In the front page of my website, I have some previews to articles (with a small introduction to them) that link to the full articles.
I want to disallow the front page to prevent duplicate content. ...
1
vote
2answers
209 views
Google is not indexing my pages [duplicate]
I just typed a post title from a few days ago into Google with "quotes" around it and nothing is showing up.
Does Google hate me? I am doing nothing but white hat marketing and even took down the ...
1
vote
3answers
557 views
How to prevent Google from finding my admin index page?
I am running a website but for some days i stopped it and put the under-construction page because the Index of admin page is visible to the outside world through the Google search. One of my friend ...
1
vote
2answers
582 views
Huge drop in indexed pages [duplicate]
Possible Duplicate:
Why the # of indexed pages got dicreased?
My site's indexed pages drop every now and then. It suddenly drops from ~800.000 to ~20.000 pages, along with a huge drop in ...
1
vote
1answer
471 views
Google is not indexing URLs in my XML SiteMap?
I have used multiple sitemap.xml for my product pages and my category pages and problem is google only not index my whole site map's link.
/sitemap_main.xml -- URLs submitted:114 // ...
1
vote
3answers
381 views
My site is indexed in Google yet does not show in the SERPs
Please someone solve this mystery that has been plaguing me for months! All pages have been cached by Google recently yet still will not show up in a search. I'm guessing it's being penalized? How ...
1
vote
2answers
57 views
Google references subfolders
Last week I launched a website and created a robots.txt:
User-agent: *
Disallow:
Sitemap: http://mywebsite.tld/sitemap_robots.xml
Now I've checked the indexed pages (Google -> ...
1
vote
2answers
93 views
Difference between canonical and base tag
I am a little bit confused regarding the usage of canonical tags and base tags.
I have placed canonical tag (rel="canonical") on my website because of my website opening with no-www. I have reviewed ...
1
vote
2answers
100 views
I don't think my site is being detected/crawled properly/having backlinks, and it's ruining SEO [closed]
This is really frustrating. I'm setting up a computer repairs business called Darley Tech. I have listed my site on many online directories to encourage backlinks. I have relevant and useful ...
1
vote
1answer
69 views
How do search engines index XML-based websites?
I'm talking about the kind that transforms XML into (X)HTML on the client side. We all know that search engines use semantics in HTML (headings, links) to rank your website. So if you don't already ...
