The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

1
vote
1answer
13 views

What are the htaccess mechanics of preventing search engines from indexing PDF files?

There are already a variety of posts on how to block certain files (in my case, PDFs) from a search engine like Google. The most relevant for this post was here: How to protect PDF file from indexing. ...
6
votes
3answers
707 views

How does Google find a domain with no links to it?

I recently registered a new domain, pointed it to my existing server, and set up a minimal page just saying "test" and nothing else. I just discovered tonight that the page is already indexed in ...
0
votes
1answer
12 views

Removing/Adding Google Listings

I have a site with user generated pages where the user can make their page "published" or "unpublished". My problem is, their pages are often indexed high on Google (usually in the top 3) and so when ...
3
votes
1answer
49 views

Replace all images when search engine crawler visits site

I have written code that will detect when a user is a search engine and i dont include css files when this happens to save bandwidth. I was also thinking i could replace ALL images on the page with a ...
0
votes
1answer
41 views

Allow google to index page loaded by ajax, but link to parent page

I have a website with a page with 10 tabs, each tab's contents is loaded by AJAX. I would like google to index the content of the tabs (loaded by AJAX), but google should allow links ONLY to the ...
2
votes
1answer
67 views

Does Bing execute Javascript when crawling and indexing web pages (like Google)?

Some content on some web pages is only displayed with Javascript when a button is clicked (for example). We know that Google executes Javascript and is (very likely) to find this content, but what ...
5
votes
2answers
343 views

Number of indexed pages with “site:” search less than reported in Google Webmaster Tools

In Google webmaster tools it shows that I have 309 pages indexed, but when I search using "site:site.com" appear about 180 only (On the first page appears "about 608 results," something near the total ...
0
votes
2answers
23 views

Removed parent category path - New URL's not showing up in Google search results

Last month we removed parent category path from the sub category URL's. After that we changed the sitemap file with new URL's and submit it to the webmaster tools for indexing. For example ...
1
vote
1answer
9 views

Submit a new site description into Google

Google indexed my site in a moment where I had the wrong content, and the search results currently show a "Loren Ipsun" text as my site description. How can I re-submit the description of my site to ...
0
votes
1answer
34 views

Is it possible to get URLs with parameters not indexed by Google if they contain hashtags?

Some sources say to use # before the parameters in URL, others recommend using #! or !#... So, if I'm using category filters on a page, to add parameters to URLs and sort items based on price, color ...
1
vote
1answer
55 views

Noindex metatag in alternate mobile version of page with canonical to desktop… What consequences?

I have a desktop site to serve content for desktop and tablet users. I also have a mobile version of the site to cater to mobile phone visitors. Desktop pages have the following kind of annotations ...
0
votes
1answer
24 views

How to Re-Crawl My Website on Google?

I have one issue with my website. When I updated the meta title and description for the first time, everything was fine and Google crawled the website within 24 hours. But now due to some keyword ...
3
votes
1answer
1k views

Google Webmaster Tools Index Status 0 for one year

I've read this topic with answers but they do not address why zero for one year? but other areas in Google Webmaster Tools report 400 URL indexed. Google Webmaster Tools Index Status Only 2 Indexed. ...
0
votes
1answer
32 views

Trick to index infinite scroll content on Google?

I have a Question & Answer website, sort of like stackoverflow. When you open it, it displays 20 latest questions. When scroll to bottom of page, and it fetches 20 more, and so on, infinitely. ...
3
votes
5answers
1k views

How to let Google know that content on the page has just changed?

I'd never thought of such a problem in the whole SEO spectrum before I considered launching my own website. Imagine that I have a website which is updated once per month and Google spider knows ...
11
votes
4answers
2k views

Prevent XML sitemaps from showing up in Google search results

How do I prevent my XML sitemap files from showing up in Google search results like this result of a site: search query: I don't understand why Google would choose to show sitemap files in search ...
2
votes
2answers
70 views

How to see which images Google has indexed from your website?

Ive got a website that is using lazy loading to load in images (so that the browser dose not try and load them all at once before they are required). The only issue with this is that there are some ...
2
votes
3answers
761 views

Why is Google Webmaster Tools account showing fewer indexed pages than a site: search?

When I have check my website index pages it is showing only 252 pages are indexed but when I checked through Google Search by typing site:http://www.example.com then is showing more then 900 pages are ...
0
votes
1answer
13 views

Testing server indexed in Google [duplicate]

Assume our website domain to be www.example.com. And we have created a separate testing environment within our main domain: Say : www.project.example.com. So we have two versions within our main ...
0
votes
1answer
22 views

Crawl errors for pdf download links in my website

We are building a local business classified website which has about 6000 unique listingsunder huge number of categories and sub-categories. For each listing there is a details page in which we have ...
5
votes
3answers
122 views

For webpages using jQuery, will the Googlebot index them on “page load” or after the “page ready” state?

Will the Googlebot index a webpage on "page load" or after the "page ready" state. The reason I'm asking is because I'm trying to change my h1 and h2 tags using jQuery on page Load.
1
vote
3answers
54 views

Preserving search engine rankings when old domain name is lost

We have a client with the unfortunate situation of losing access to their current domain name "A". We've just finished finished setting their website up on domain "B". Both websites on "A" and "B" ...
1
vote
0answers
87 views

Google shows different results for my brandname in their SERP

When I typed site:example.com in Google's search box, it's displaying a different title and meta description, but the thing puzzling me is the site URL is being displayed correctly and redirected to ...
0
votes
0answers
13 views

Shall i make mobile version of my website indexed by search engines? [duplicate]

I have a website with a separate version for mobile and smart phones but the user cannot open the mobile version from Desktop and vise versa the Desktop version cannot opened from Mobile device(s). ...
0
votes
2answers
162 views

Opening forum for search engine bots and SEO

We develop and sell components for other software developers through our website. The main products are ActiveX and WinFroms.NET grid controls. Some years ago we established a forum dedicated to our ...
4
votes
2answers
98 views

Preserve search engine rankings while shifting to new domain name

We have to shift our web-site to a new domain due to some unavoidable circumstances. The portal has been up and running there since 2009. It has good index in various search engines and we are ...
2
votes
2answers
69 views

robots meta not blocking indexing

We have a staging version of our website to test changes on at trailheadpaddleshack.ca/staging1. This never appeared in search before. Recently the staging site has appeared on Google and is affecting ...
0
votes
0answers
6 views

My new website doesn't show up in Google search [duplicate]

My new website went online almost a month, but still nothing show up in Google search. Google has indexed my website in webmaster tools and sitemap, but do not show any results in search, even I ...
4
votes
3answers
177 views

How do I prevent Google from indexing text that is generated by JavaScript?

Google is executing the JavaScript on my password creator website and indexing the random passwords that get generated by the JavaScript. The random text that is generated could look spammy to ...
5
votes
3answers
306 views

Best approach to have Google index content primarily generated by Javascript

I'm developing an app where customers can drop in a Javascript tag onto their website, and it will generate content. What is the best approach to have Google index this content and associate it with ...
2
votes
0answers
39 views

Webpages being de-indexed seemingly for no reason [duplicate]

Last Wednesday my site had a ton of its paged de-indexed by Google and it's caused a drop of over 60% in overall site traffic :(... One of the pages used to rank first page #1-3 and now it doesn't ...
2
votes
3answers
1k views

Why are my posts omitted from Google search results when my site is listed in it?

My domain is not new at all, in fact I have waited for quite a long time now for Google to show some love. If I do a search for my domain name, it shows the website is listed, but if I try to search ...
4
votes
2answers
465 views

Informing Google of URL Structure Change

I have a website and the URLS were constructed like so: /index.php/Topic /index.php/AnotherTopic These were indexed in google and search results returned that pointed to these. However, I've ...
6
votes
2answers
1k views

Can you use googleon and googleoff comments to prevent Googlebot from indexing part of a page?

I've seen code like for preventing Google from indexing part of a page: <p>This is a paragraph that will be indexed by Google.</p> <!--googleoff: index--> <p>This is a ...
7
votes
3answers
50 views

Is there a way to show Google and other robots a URL to original-sized image without anchor?

Let's assume I have an image. <img src="book_thumb.jpg"> And I want it to be indexed in Google and other search engines, but in its normal size, not as a thumbnail. So I just want Google to ...
3
votes
1answer
1k views

Is there a way to bulk submit URLs to Fetch as Google?

Google is taking a while to re-index changes I have made to thousands of pages, so I want to use Fetch as Google to give it a prompt. However, you can only enter 1 URL at a time as standard. Is there ...
1
vote
2answers
79 views

How can I submit my site's URL to search engines?

I have a site but I cannot get its URL indexed in search engines like Google, Yahoo, Bing, etc... Please let me know how I can submit my site's URL to Google.
1
vote
1answer
37 views

How to stop beta websites indexing in Google Search? [duplicate]

I want stop my beta.example.com being indexed by search engines, because it can generate duplication issue.
0
votes
1answer
74 views

Google Webmaster: Crawl Stat Increase, but Index status stay flat for days

Back in June, my website experienced a significant drop in index status from 73,000 to 36 and my website cannot be found in Google search. A few days ago, a friend programmer fixed the problem that ...
0
votes
1answer
37 views

Does the following robots.txt block all pages

I want to knew if the following robots.txt file block the whole pages from being indexed or not. User-agent: * Disallow: Disallow: /cgi-bin/
1
vote
2answers
275 views

Google is indexing pages with a “noindex” robots meta tag

I have come across a very annoying problem. I have several pages that shouldn't be indexed, as they are basically pop-up pages and "thanks for signing up" pages. I have set them up with the robots ...
1
vote
2answers
293 views

Google Webmaster Tools not showing index pages

I have submitted sitemap and also fetched pages of my sites but still its showing error like "domain with protocol https://www.domain-name is not available try with http://www.domain-name.html". ...
0
votes
0answers
42 views

How long does it take to re-index the website via noarchinve tag?

I read elsewhere on here that one can't re-index their site with google, but I like to challenge that. Currently, I have every page on my website (that contains about 1,000,000 pages) labeled with a ...
1
vote
2answers
50 views

Google Site: listing Parent Domain directory Index

Currently when we search site:domain.com on google we get a return of 3.6 million pages indexed, About 3,650,000 results (0.31 seconds). When we search site:domain.com/childdirectory we get 3.8 ...
1
vote
1answer
23 views

Changing headers for small screens - SEO implications

I'm changing some of my pages to better display in different devices (tables, smart phones etc). I want to figure out a good way of handling headings. So far my options are hide headings for small ...
3
votes
1answer
378 views

I used rel=“canonical” and hreflang=“x-default”, but global site is missing and receiving “no return tags” error

Here is a sample of the code <link rel="canonical " href="http://www.kaspersky.com/anti-virus-trial" hreflang="en" /> <link rel="alternate" ...
1
vote
2answers
246 views

Conflicting test results when using The Mobile-Friendly Test and PageSpeed Insights

Our website uses an open source product to detect user agent and based on that, it servers mobile theme or desktop theme to users. I know the exact difference between mobile-friendly test and ...
7
votes
4answers
3k views

How to get tens of millions of pages indexed by Google bot?

We are currently developing a site that currently has 8 million unique pages that will grow to about 20 million right away, and eventually to about 50 million or more. Before you criticize... Yes, it ...
2
votes
1answer
298 views

Google indexing fewer images after switching to CDN

After switching to a CDN I noticed that my indexed image count went down. I have close to 1000 images on the site with correct tags, alt tags, and all of that. Only 50 are actually being indexed in ...
3
votes
6answers
2k views

How quickly does Bing index URLs submitted through Webmaster Tools?

In Bing's Webmaster Tools, there is a Submit URLs page that allows you to "Submit URLs that are currently not in the Bing index or that should be reindexed due to recent changes." Does anyone know ...