The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

0
votes
0answers
16 views

Indexing in Webmaster Tools [on hold]

I've submitted a sitemap of my website in Webmaster tools. Submitted - 21 Indexed - 1 What is the reason behind only 1 page getting Indexed. You help is highly appreciated.
0
votes
1answer
25 views

Does the following robots.txt block all pages

I want to knew if the following robots.txt file block the whole pages from being indexed or not. User-agent: * Disallow: Disallow: /cgi-bin/
1
vote
2answers
48 views

How can I submit my site's URL to search engines?

I have a site but I cannot get its URL indexed in search engines like Google, Yahoo, Bing, etc... Please let me know how I can submit my site's URL to Google.
1
vote
2answers
210 views

Google is indexing pages with a “noindex” robots meta tag

I have come across a very annoying problem. I have several pages that shouldn't be indexed, as they are basically pop-up pages and "thanks for signing up" pages. I have set them up with the robots ...
0
votes
0answers
20 views

How long does it take to re-index the website via noarchinve tag?

I read elsewhere on here that one can't re-index their site with google, but I like to challenge that. Currently, I have every page on my website (that contains about 1,000,000 pages) labeled with a ...
1
vote
2answers
22 views

Google Site: listing Parent Domain directory Index

Currently when we search site:domain.com on google we get a return of 3.6 million pages indexed, About 3,650,000 results (0.31 seconds). When we search site:domain.com/childdirectory we get 3.8 ...
0
votes
0answers
1 view

How to get the special price index to update automatically in Magento when special prices expire? [migrated]

I set special prices for some products with defined date when special price should expire. The problem is that the price index is not automatically running when those prices expire. [Sic!: Price ...
1
vote
2answers
143 views

Conflicting test results when using The Mobile-Friendly Test and PageSpeed Insights

Our website uses an open source product to detect user agent and based on that, it servers mobile theme or desktop theme to users. I know the exact difference between mobile-friendly test and ...
1
vote
1answer
20 views

Changing headers for small screens - SEO implications

I'm changing some of my pages to better display in different devices (tables, smart phones etc). I want to figure out a good way of handling headings. So far my options are hide headings for small ...
2
votes
1answer
31 views

X-Robots noindex a folder of PDFs

I'd like to noindex a group of PDFs within a certain folder. There are other PDFs on site that I do want indexed, so I want to avoid using <FilesMatch ".pdf$"> Header set X-Robots-Tag "noindex, ...
2
votes
1answer
53 views

How do I make it clear to Google that my domain name contains `www` like www.wwwexample.com?

I've noticed that domain names containing www (e.g., http://www.wwwexample.com) sometimes are ranked lower in search results. I have also noticed that Google assumes it to be www.example.com. For ...
2
votes
1answer
90 views

Google indexed my website name with a space

Google has indexed my website name with a space between 2 words. Search intellisense shows my website name with a space between both the words. Ex: word1 word2 (Stack Overflow) What I want is that ...
2
votes
1answer
48 views

Does Google treat different ports as different sites?

I host my website on Azure and I have recently activated a feature to make it possible for me to directly access each server instance in our web farm by a port number. For example ...
0
votes
0answers
23 views

How do I get Google to index my 30 million pages? [duplicate]

I am releasing a website which has 30 million pages of content. (This isn't spam material). It has a detail page for each of the 30 million places around the World. e.g ...
1
vote
1answer
61 views

Incorrect subdomain of staging site showing up in Google SERP

I have a staging site where we do our work and show to clients. The site was created before I started and it wasn't set up with a disallow / in robots.txt or a meta no-index before it was created, so ...
0
votes
1answer
66 views

Will Google penalize me for duplicate content on GitHub from my knowledge base?

I want to have a copy of each of our documentation articles in GitHub so that other users can improve, edit and add to the document. The accepted changes will be made live in our knowledge base forum. ...
2
votes
3answers
90 views

How can I force Google to re-crawl a link?

Google Webmaster Tools is showing thousands of links from a North Korean travel agency, but when I go to the link, they don't exist! How can I force Google to re-index that link so it drops off my ...
5
votes
2answers
418 views

Why in the search results of Google does not appear the unique name of my website?

I have a website with a unique name, already indexed and with a perfect SEO. Although there are no websites with the same unique name, when I'm searching on Google I found my homepage listed on the ...
3
votes
1answer
235 views

I used rel=“canonical” and hreflang=“x-default”, but global site is missing and receiving “no return tags” error

Here is a sample of the code <link rel="canonical " href="http://www.kaspersky.com/anti-virus-trial" hreflang="en" /> <link rel="alternate" ...
0
votes
0answers
17 views

Decrease in index URLs,and drop in traffic [duplicate]

A site that I work for has had a drop in traffic over the last few weeks.and also Decrease in INDEXING the no of URL's . However, having had a look in Google Webmaster tools, there has been a big ...
0
votes
0answers
11 views

How this type of search engine index result is working? [duplicate]

For example when you Google "stack overflow" or any other popular website, the result is indexing like above image. what should i do, if i want my website look like above image in search engine ...
0
votes
0answers
5 views

Google not indexing site [duplicate]

I have had a site up for some time and am not being indexed at all by Google. I can't work out what is blocking the site from being indexed. I have tried Google Webmaster Tools but it isn't giving ...
0
votes
0answers
25 views

Google still returns old Wordpress user name when I search for it [duplicate]

I created a Wordpress website with a particular user name that I no longer use (I fully deleted the Wordpress user and created a new one). Yet when I run a Google search for the initial user name, my ...
0
votes
1answer
31 views

How to tell Google only crawl direct links?

I have some links that want to Google index it so I put those links in a separate simple HTML file, updated my sitemap to Google know about this page and just link my desired pages on that now I want ...
3
votes
1answer
49 views

Two kinds of Google index

I am curious about information that gave me Google's Webmaster Tools. Because I see two different information about Google index of same webpage in same time. First information (sitemap files) I ...
0
votes
1answer
53 views

Google Webmaster: Crawl Stat Increase, but Index status stay flat for days

Back in June, my website experienced a significant drop in index status from 73,000 to 36 and my website cannot be found in Google search. A few days ago, a friend programmer fixed the problem that ...
1
vote
3answers
59 views

How can pages which aren't indexed be reported as landing pages in Google Analytics?

In Google Analytics I have thousands of landing pages reported, however on checking some of them they aren't indexed in Google, this is expected as the have robots NOINDEX tag in the source code. So ...
0
votes
1answer
99 views

sitemap.xml for a website with forum

We have a website dedicated to our ActiveX and .NET components that has been working for more than 12 years. The site consists of 2 parts: the static part (product descriptions and articles) and the ...
0
votes
2answers
37 views

How to remove a page from the Google search results [duplicate]

Google says one can use the following method to remove a page from the search results: by putting -http://www.example.com/outdated.html into the sitemap. But what if the site does not exist anymore.
1
vote
2answers
59 views

Are links within SlideShare presentations indexed by search engines?

I have created a PDF presentation including links to a site I own on the last slide. So far, such links are not reported in Google Webmaster Tools. When I search Google for the presentation, I can ...
4
votes
2answers
209 views

Prevent Googlebot from seeing or indexing common keywords such as “read full story”

I have a site that uses a lot of the same anchor text. For example, "read full story". When I do an SEO audit for my site, I find that these are my most frequent keywords, but I am not trying to ...
1
vote
1answer
48 views

Would adding noindex on index.html stop main domain from being indexed?

For various reasons, I don't want my domain.com/index.html from being indexed because I have the same file with the same content but called domain.com/home.html instead. Now I added the noindex meta ...
9
votes
3answers
1k views

How do I find when an URL was first indexed by Google?

How do I find out when a particular URL was first indexed by Google? I'd prefer a solution that works even for competitors' URLs that are not owned by me.
4
votes
2answers
275 views

Number of indexed pages with “site:” search less than reported in Google Webmaster Tools

In Google webmaster tools it shows that I have 309 pages indexed, but when I search using "site:site.com" appear about 180 only (On the first page appears "about 608 results," something near the total ...
1
vote
1answer
217 views

Change to www from naked domain impact on seo

I have set up my website from the beginning to be used without the www, ie 'naked', with the following command at .htaccess and everything is working fine. RewriteCond %{HTTP_HOST} ...
2
votes
0answers
51 views

Indexing several editions of a same event [closed]

We have a website presenting sport events, mostly annual. Each URL contains the event's year and name. E.g: /marathon/my-event-2014 /marathon/my-event-2015 /marathon/my-event-2016 (the reason why ...
1
vote
1answer
45 views

Notify search engine crawlers about user generated content so that our rankings are not biased by keywords used by users

Is there a meta tag or a way to notify crawlers that a page is generated by the user? To clarify the issue, We have a website already promoted by SEO and we want to add dynamic user generated content ...
2
votes
1answer
150 views

Website not fetched by Bingbot: Unexpected Error

My website has been online for a couple years. It's on the first result for Google but it doesn't seem to be indexed by Bing. I tried to fetch it with bing in their webmaster tools and it always ...
2
votes
1answer
136 views

Is it bad to have both www and the naked domain indexed in Google? Should both be added to webmaster tools?

Currently when searching on Google, the www.example.com version will appear as opposed to example.com. I realize that isn't a big deal, however it made me wonder if I should do some of the same ...
2
votes
3answers
85 views

Having issues getting new pages indexed in Google

We are having issues getting our new pages crawled by Google and cannot figure out why. We've done lots of research and are still having trouble finding answers. Here's some information regarding our ...
2
votes
1answer
36 views

Is it unusual for Google to take more than five days to include a new site in the search index?

I recently launched a brand new website. It's a travel guide with around 260 unique pages with lots of newly written content and unique images. I submitted the site to Google 5 days ago and at the ...
3
votes
2answers
86 views

How can I get Google to index content that is written into the page with JavaScript?

I have a website that focuses on charts and graphs. The graphs on the site are drawn using JavaScript, but contain keywords that I would like to have indexed. For example, here is a screenshot of ...
1
vote
4answers
44 views

How to remove a website completely from search engine indexes except the home page?

I want to de-index all the pages of my website except home page. This is because it is an exact match domain (EMD) and I'm getting traffic on website just because of Domain name. I want to restart ...
1
vote
2answers
46 views

After the home page was redirected by a hack, it is no longer indexed. How long until it comes back?

My site was hacked, and the index page was 302 redirected. It took me a few months to get all this sorted. In the meantime, the home page lost its PageRank and was no longer included in the index. I ...
0
votes
1answer
22 views

Do bookmarks inside a document help search engines indexing content?

Say someone implements a FAQ page and decides to use bookmarks in their page, for example: <a id="Question2"></a><h2>My faq question 2?</h2> Does it help search engines ...
3
votes
1answer
704 views

Is there a way to bulk submit URLs to Fetch as Google?

Google is taking a while to re-index changes I have made to thousands of pages, so I want to use Fetch as Google to give it a prompt. However, you can only enter 1 URL at a time as standard. Is there ...
0
votes
0answers
11 views

Problem indexing my site [duplicate]

I developed a site but I've got some problems to index it. I've got 10 pages but when I search my site on google the first result is the page "contact" and not "index". I have included title and meta ...
2
votes
0answers
39 views

How come a site is indexed but not indexed? [closed]

An example URL: islamqa.info/ar The site is indexed in Google Webmaster Tools as per this image But When I use google site: operator, I get Your search - site:islamqa.info/ar - did not match any ...
3
votes
4answers
445 views

Should I use 'robots.txt' or 'sitemap.xml' to get dynamically created files indexed in search engines?

I've structure my video site like this: / (root) index.html -/videos -/video-id1 (dynamically generated subdirectory when user uploads a video) /index.html (dynamically generated file ...
0
votes
2answers
51 views

Does Googlebot (and/or search engines) index a forwarded page? [duplicate]

Let's say I have example.com domain, and I force the user to use the HTTPS over HTTP. The question is as browsers just accept and load the forwarded/new page (when the request for http://example.com ...