The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

2
votes
2answers
128 views

problem showing my website correctly in search engines

I have a website which i have indexed on google for example (like 15 days ago). some of my pages pass arguments like: http://www.bla.com/products.php?pro=bla&page=view suddently i saw that ...
2
votes
1answer
252 views

Should I strategically use NoFollow on internal links to make our indexing crawl more efficient?

We have a well designed internal linking system that makes certain no page is more than four pages deep, and the indexing process has gone well for us. However, in addition to the hierarchical page ...
2
votes
3answers
162 views

Site not indexed by Google [duplicate]

I typed the following on Google: (1) site: uniquevolve.com (2) site: uniquevolve.com.au Only (2) gets indexed. Is this normal? The strange thing is, my Website is actually hosted on the server with ...
2
votes
1answer
45 views

Dynamic Serving: Verifying which version of the page Google is showing on Mobile SERPs

We have a large content/informational site which serves pages dynamically based on user device (the same URL for both desktop and mobile). Title tags for mobile pages do not match those set for ...
2
votes
1answer
632 views

Does Bing execute Javascript when crawling and indexing web pages (like Google)?

Some content on some web pages is only displayed with Javascript when a button is clicked (for example). We know that Google executes Javascript and is (very likely) to find this content, but what ...
2
votes
2answers
189 views

How to see which images Google has indexed from your website?

Ive got a website that is using lazy loading to load in images (so that the browser dose not try and load them all at once before they are required). The only issue with this is that there are some ...
2
votes
1answer
184 views

Google indexed my website name with a space

Google has indexed my website name with a space between 2 words. Search intellisense shows my website name with a space between both the words. Ex: word1 word2 (Stack Overflow) What I want is that ...
2
votes
3answers
1k views

How can I force Google to re-crawl a link?

Google Webmaster Tools is showing thousands of links from a North Korean travel agency, but when I go to the link, they don't exist! How can I force Google to re-index that link so it drops off my ...
2
votes
3answers
128 views

Having issues getting new pages indexed in Google

We are having issues getting our new pages crawled by Google and cannot figure out why. We've done lots of research and are still having trouble finding answers. Here's some information regarding our ...
2
votes
1answer
100 views

Google not indexing my Mediawiki's jpg files description pages

My website es.wikineos.com has been running for a few years with the MediaWiki Content Management System like the one they use at Wikipedia. Google seems to be indexing my site correctly at a quick ...
2
votes
4answers
278 views

How long for Google to index all site maps?

We recently uploaded new sitemaps, as the old ones were out of date and we've also upgraded our forum which changed the URLs of a lot of our website (we're 301 redirecting of course). We uploaded the ...
2
votes
3answers
1k views

Why is Google Webmaster Tools account showing fewer indexed pages than a site: search?

When I have check my website index pages it is showing only 252 pages are indexed but when I checked through Google Search by typing site:http://www.example.com then is showing more then 900 pages are ...
2
votes
2answers
159 views

Can you create a private website without password protection that would not be indexed?

I'd like to create a "private" website that clients can visit by typing in the provided direct URL (on a business card, for example), but is not password protected and would not be indexed by search ...
2
votes
1answer
148 views

Do sites using YouTube video API get indexed by Google?

Suppose I design a small app that heavily depends on Google YouTube API to dynamically fetch hundreds of YouTube video data. My site will be able to respond to users' requests, and generate several ...
2
votes
1answer
317 views

Will Google index images from HTML select tag

If i have code like this: <select> <option value="path/to/image1.jpg">Image 1</option> <option value="path/to/image2.jpg">Image 2</option> <option ...
2
votes
2answers
220 views

Is it better to burn old domain names and 301 to a new one for domains that experienced a high number of errors?

As discussed in this topic, several sites were down due to a server issue for about a month. I have slowly watched some of the more popular sites gain some traffic. I did say slowly. I have also ...
2
votes
2answers
150 views

Prevent crawler that doesn't honoring robots.txt

I have some problem, when I try to write robots.txt for my site ... I find some issues by search on Google, and tell me about honor and not honoring robots.txt, how I can prevent it, can I perform it ...
2
votes
2answers
131 views

Blogger still visible after moving to WP; Google Indexing issues after moving from Blogger to WP

I recently migrated from Blogger to Wordpress and am having two major transition issues that are really hurting. Despite literally hours of searching and experimenting, I cannot resolve the following: ...
2
votes
1answer
88 views

How to optimize website for SEO when content is accessed via one search field

We are developing a website (sort of information index for companies) where almost all content is accessed via one search field (similar to Google): you type a search phrase, get results and then can ...
2
votes
2answers
466 views

Should I notify 'under construction' websites to crawlers? If yes how?

I am currently developing a website which is going to take some time to finish. I need to move some 'stuff' to production frequently, while maintaining a under construction status. My front page will ...
2
votes
2answers
196 views

Old pages still appearing in Google?

Many pages that have been deleted for a long time are still appearing in Google? When I then click on them, they obviously can't be found. Am I doing something wrong/forgetting something?
2
votes
1answer
283 views

Why do Google FreshBot crawled and indexed pages disappear from SERPs? Will they come back?

Sometimes a page on our site will show up in the Google SERPs that was previously not indexed (yet) due to a news story or blog posting on another site that points to it. From what I understand, the ...
2
votes
2answers
36 views

Can I create website translations on subdomains or folders without losing my current English rankings?

I have a running website of with some hundreds of thousands of pages already indexed, let's say example.com Website needs to be translated to some other languages with the purpose of getting more ...
2
votes
2answers
39 views

Pages are returning a 403 response code and not getting indexed in Google

I am working on a website but not all of its pages are getting indexed in Google. Everything seems fine to me from the URL structure to the canonical tag. However, when I check the pages header ...
2
votes
1answer
31 views

Google indexed work-in-progress page. how to delete it from Google index?

I developed a page under the following URL: example.org/dev Since the development is finished, I moved the page to the root at example.org/ For some reason, Google indexed the page during ...
2
votes
1answer
76 views

Making one image non-indexable to search engines in webpage

On my contact page, its a form where people can select a department to contact, then they fill out basic information (name, email and message). Additionally, a PHP script is called (via the HTML IMG ...
2
votes
1answer
104 views

X-Robots noindex a folder of PDFs

I'd like to noindex a group of PDFs within a certain folder. There are other PDFs on site that I do want indexed, so I want to avoid using <FilesMatch ".pdf$"> Header set X-Robots-Tag "noindex, ...
2
votes
1answer
62 views

How do I make it clear to Google that my domain name contains `www` like www.wwwexample.com?

I've noticed that domain names containing www (e.g., http://www.wwwexample.com) sometimes are ranked lower in search results. I have also noticed that Google assumes it to be www.example.com. For ...
2
votes
1answer
40 views

Is it unusual for Google to take more than five days to include a new site in the search index?

I recently launched a brand new website. It's a travel guide with around 260 unique pages with lots of newly written content and unique images. I submitted the site to Google 5 days ago and at the ...
2
votes
1answer
311 views

Is there an alternative to using an iframe so that my content would be visible to search engines?

I have a book-length document that is typeset with the LaTex typesetting system (It's a markup language popular for science and math typesetting.) A custom script runs a program called HyperLatex ...
2
votes
2answers
41 views

How to prevent Google from indexing non-domain URL of website?

My webhost gives you two URLs for your website: the URL on your shared server, which is something like usr283725992783.webhost.com and your domain URL, which is www.example.com Google is indexing ...
2
votes
1answer
426 views

What replaces meta keywords if Google doesn't use them anymore? [duplicate]

As a majority of webmasters already know that Google does not use Keywords anymore to help index a website properly. Which is understandable by people exploiting the system to try to gain a better ...
2
votes
1answer
65 views

Robots and Sitemaps

I have some problems regarding indexing. Google indexed so much in the list. Now I wanted to remove everything from my site. If I have disallow all in robots.txt and send my sitemap.xml. Would ...
2
votes
1answer
88 views

Google images directing to url with Escaped Fragment

I'm running an ajax website with images and using Google's guidelines for ajax webistes. My site is indexed correctly in Google's web search. But in image search the _escaped_fragment_ appears in the ...
2
votes
1answer
25 views

Should I add a site root to the sitemap file?

Is it really necessary to include a root (homedir) of the site to the sitemap? As I can understand the sitemaps main idea - it is not any necessary. Am I right?
2
votes
2answers
833 views

301 redirect from HTTP to HTTPS - how to be sure Google is fetching the correct information?

I'm hoping somebody might be able to provide a bit of advice on an issue I am having. I have one site where we implemented a 301 redirect on the homepage from HTTP to HTTPS. We have links on the ...
2
votes
1answer
60 views

Is this considered to be “Internal Near-Duplicates”?

Some people generate the same pages with a slight variation in keywords, title, country name, region name, etc... This is typically considered to be "Internal Near-Duplicates." I have seen a website ...
2
votes
2answers
76 views

Should I have link rel=next & prev on URLs which have query variables?

For example, I have link rel prev & next set up on these pages of products: site.com?page=2 site.com?page=3 (this is my preferred structure by the way and I'm trying to get all the ugly URLs ...
2
votes
1answer
175 views

JavaScript loaded external content SEO

I wonder what is the best way to have Javascript loaded content indexed by search engines. I know that search engines don't execute Javascript, but I am thinking more of an progressive enchantment. I ...
2
votes
1answer
102 views

Why is Google indexing all these other websites?

I run a web hosting company and I have noticed something strange about the way my website and the other websites that I host are indexed in Google. For some reason, other websites that I am hosting ...
2
votes
1answer
153 views

Lasting discrepancy between the site command and indexed pages in Google Webmaster

I have recently uploaded a blog on blogger. The pages of my blog are accessible for crawling and indexing and I can see that some crawling has started two weeks ago. I have noticed that the ...
2
votes
1answer
267 views

301 redirect to different page on different domain?

I want to make a 301 redirect to a different page on a different domain. The page is on the same topic, but is different content. Also, the traffic to the original page comes from the alt text on an ...
2
votes
1answer
358 views

how to set 301 redirect in wordpress .htacces file

In continuation of my previously asked question preserve-search-engine-index-while-shifting-to-new-domain. The migration is being done in the word-press and we will have same server with same IP.Since ...
2
votes
5answers
89 views

Prevent robots from indexing specific word

I need to prevent robots from indexing specific word on my webpage. Here is what I did: Let's say I need to prevent JOHN GALLOW from being indexed. For that purpose, I wrote this pararaph: Over the ...
2
votes
1answer
42 views

Moving a secondary site form a www.example.com/subdirectory to another www domain

I have added all my websites on Webmaster Tools (Google Search Console), but I have a question about moving a different site from a subdirectory to another www domain. I added on Webmaster Tools and ...
2
votes
1answer
36 views

deindexing a whole domain with robots.txt created problems in google webmaster tools

In my robots.txt for my domain that just hosts images, I used the following lines: user-agent: * noindex: / I thought I was doing search engines a wonderful favor by not having them crawl through ...
2
votes
1answer
48 views

Indexing protected PDF files

It is my intention to use protected PDF files on my web journal, the type that does not allow the text to be copied. I would like to know if this will affect its indexing on Google Scholar, and if ...
2
votes
0answers
165 views

Google shows different results for my brandname in their SERP

When I typed site:example.com in Google's search box, it's displaying a different title and meta description, but the thing puzzling me is the site URL is being displayed correctly and redirected to ...
2
votes
0answers
39 views

Webpages being de-indexed seemingly for no reason [duplicate]

Last Wednesday my site had a ton of its paged de-indexed by Google and it's caused a drop of over 60% in overall site traffic :(... One of the pages used to rank first page #1-3 and now it doesn't ...
2
votes
0answers
55 views

Indexing several editions of a same event [closed]

We have a website presenting sport events, mostly annual. Each URL contains the event's year and name. E.g: /marathon/my-event-2014 /marathon/my-event-2015 /marathon/my-event-2016 (the reason why ...