The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

1
vote
2answers
79 views

Google Site: listing Parent Domain directory Index

Currently when we search site:domain.com on google we get a return of 3.6 million pages indexed, About 3,650,000 results (0.31 seconds). When we search site:domain.com/childdirectory we get 3.8 ...
1
vote
2answers
366 views

Conflicting test results when using The Mobile-Friendly Test and PageSpeed Insights

Our website uses an open source product to detect user agent and based on that, it servers mobile theme or desktop theme to users. I know the exact difference between mobile-friendly test and ...
1
vote
1answer
28 views

Changing headers for small screens - SEO implications

I'm changing some of my pages to better display in different devices (tables, smart phones etc). I want to figure out a good way of handling headings. So far my options are hide headings for small ...
2
votes
1answer
108 views

X-Robots noindex a folder of PDFs

I'd like to noindex a group of PDFs within a certain folder. There are other PDFs on site that I do want indexed, so I want to avoid using <FilesMatch ".pdf$"> Header set X-Robots-Tag "noindex, ...
2
votes
1answer
62 views

How do I make it clear to Google that my domain name contains `www` like www.wwwexample.com?

I've noticed that domain names containing www (e.g., http://www.wwwexample.com) sometimes are ranked lower in search results. I have also noticed that Google assumes it to be www.example.com. For ...
2
votes
1answer
192 views

Google indexed my website name with a space

Google has indexed my website name with a space between 2 words. Search intellisense shows my website name with a space between both the words. Ex: word1 word2 (Stack Overflow) What I want is that ...
2
votes
1answer
172 views

Does Google treat different ports as different sites?

I host my website on Azure and I have recently activated a feature to make it possible for me to directly access each server instance in our web farm by a port number. For example ...
0
votes
0answers
27 views

How do I get Google to index my 30 million pages? [duplicate]

I am releasing a website which has 30 million pages of content. (This isn't spam material). It has a detail page for each of the 30 million places around the World. e.g ...
1
vote
1answer
113 views

Incorrect subdomain of staging site showing up in Google SERP

I have a staging site where we do our work and show to clients. The site was created before I started and it wasn't set up with a disallow / in robots.txt or a meta no-index before it was created, so ...
1
vote
1answer
173 views

Will Google penalize me for duplicate content on GitHub from my knowledge base?

I want to have a copy of each of our documentation articles in GitHub so that other users can improve, edit and add to the document. The accepted changes will be made live in our knowledge base forum. ...
3
votes
3answers
1k views

How can I force Google to re-crawl a link?

Google Webmaster Tools is showing thousands of links from a North Korean travel agency, but when I go to the link, they don't exist! How can I force Google to re-index that link so it drops off my ...
5
votes
2answers
836 views

Why in the search results of Google does not appear the unique name of my website?

I have a website with a unique name, already indexed and with a perfect SEO. Although there are no websites with the same unique name, when I'm searching on Google I found my homepage listed on the ...
4
votes
1answer
708 views

I used rel=“canonical” and hreflang=“x-default”, but global site is missing and receiving “no return tags” error

Here is a sample of the code <link rel="canonical " href="http://www.kaspersky.com/anti-virus-trial" hreflang="en" /> <link rel="alternate" ...
0
votes
0answers
17 views

Decrease in index URLs,and drop in traffic [duplicate]

A site that I work for has had a drop in traffic over the last few weeks.and also Decrease in INDEXING the no of URL's . However, having had a look in Google Webmaster tools, there has been a big ...
0
votes
0answers
25 views

Google still returns old Wordpress user name when I search for it [duplicate]

I created a Wordpress website with a particular user name that I no longer use (I fully deleted the Wordpress user and created a new one). Yet when I run a Google search for the initial user name, my ...
0
votes
1answer
73 views

How to tell Google only crawl direct links?

I have some links that want to Google index it so I put those links in a separate simple HTML file, updated my sitemap to Google know about this page and just link my desired pages on that now I want ...
3
votes
1answer
79 views

Two kinds of Google index

I am curious about information that gave me Google's Webmaster Tools. Because I see two different information about Google index of same webpage in same time. First information (sitemap files) I ...
0
votes
1answer
130 views

Google Webmaster: Crawl Stat Increase, but Index status stay flat for days

Back in June, my website experienced a significant drop in index status from 73,000 to 36 and my website cannot be found in Google search. A few days ago, a friend programmer fixed the problem that ...
1
vote
3answers
287 views

How can pages which aren't indexed be reported as landing pages in Google Analytics?

In Google Analytics I have thousands of landing pages reported, however on checking some of them they aren't indexed in Google, this is expected as the have robots NOINDEX tag in the source code. So ...
0
votes
1answer
370 views

sitemap.xml for a website with forum

We have a website dedicated to our ActiveX and .NET components that has been working for more than 12 years. The site consists of 2 parts: the static part (product descriptions and articles) and the ...
0
votes
2answers
48 views

How to remove a page from the Google search results [duplicate]

Google says one can use the following method to remove a page from the search results: by putting -http://www.example.com/outdated.html into the sitemap. But what if the site does not exist anymore.
1
vote
3answers
150 views

Are links within SlideShare presentations indexed by search engines?

I have created a PDF presentation including links to a site I own on the last slide. So far, such links are not reported in Google Webmaster Tools. When I search Google for the presentation, I can ...
5
votes
2answers
531 views

Prevent Googlebot from seeing or indexing common keywords such as “read full story”

I have a site that uses a lot of the same anchor text. For example, "read full story". When I do an SEO audit for my site, I find that these are my most frequent keywords, but I am not trying to ...
1
vote
1answer
80 views

Would adding noindex on index.html stop main domain from being indexed?

For various reasons, I don't want my domain.com/index.html from being indexed because I have the same file with the same content but called domain.com/home.html instead. Now I added the noindex meta ...
9
votes
3answers
2k views

How do I find when an URL was first indexed by Google?

How do I find out when a particular URL was first indexed by Google? I'd prefer a solution that works even for competitors' URLs that are not owned by me.
7
votes
3answers
737 views

Number of indexed pages with “site:” search less than reported in Google Webmaster Tools

In Google webmaster tools it shows that I have 309 pages indexed, but when I search using "site:site.com" appear about 180 only (On the first page appears "about 608 results," something near the total ...
1
vote
1answer
468 views

Change to www from naked domain impact on seo

I have set up my website from the beginning to be used without the www, ie 'naked', with the following command at .htaccess and everything is working fine. RewriteCond %{HTTP_HOST} ...
2
votes
0answers
55 views

Indexing several editions of a same event [closed]

We have a website presenting sport events, mostly annual. Each URL contains the event's year and name. E.g: /marathon/my-event-2014 /marathon/my-event-2015 /marathon/my-event-2016 (the reason why ...
1
vote
1answer
63 views

Notify search engine crawlers about user generated content so that our rankings are not biased by keywords used by users

Is there a meta tag or a way to notify crawlers that a page is generated by the user? To clarify the issue, We have a website already promoted by SEO and we want to add dynamic user generated content ...
2
votes
1answer
432 views

Website not fetched by Bingbot: Unexpected Error

My website has been online for a couple years. It's on the first result for Google but it doesn't seem to be indexed by Bing. I tried to fetch it with bing in their webmaster tools and it always ...
2
votes
1answer
227 views

Is it bad to have both www and the naked domain indexed in Google? Should both be added to webmaster tools?

Currently when searching on Google, the www.example.com version will appear as opposed to example.com. I realize that isn't a big deal, however it made me wonder if I should do some of the same ...
2
votes
3answers
130 views

Having issues getting new pages indexed in Google

We are having issues getting our new pages crawled by Google and cannot figure out why. We've done lots of research and are still having trouble finding answers. Here's some information regarding our ...
2
votes
1answer
40 views

Is it unusual for Google to take more than five days to include a new site in the search index?

I recently launched a brand new website. It's a travel guide with around 260 unique pages with lots of newly written content and unique images. I submitted the site to Google 5 days ago and at the ...
3
votes
2answers
167 views

How can I get Google to index content that is written into the page with JavaScript?

I have a website that focuses on charts and graphs. The graphs on the site are drawn using JavaScript, but contain keywords that I would like to have indexed. For example, here is a screenshot of ...
1
vote
4answers
60 views

How to remove a website completely from search engine indexes except the home page?

I want to de-index all the pages of my website except home page. This is because it is an exact match domain (EMD) and I'm getting traffic on website just because of Domain name. I want to restart ...
1
vote
2answers
59 views

After the home page was redirected by a hack, it is no longer indexed. How long until it comes back?

My site was hacked, and the index page was 302 redirected. It took me a few months to get all this sorted. In the meantime, the home page lost its PageRank and was no longer included in the index. I ...
0
votes
1answer
28 views

Do bookmarks inside a document help search engines indexing content?

Say someone implements a FAQ page and decides to use bookmarks in their page, for example: <a id="Question2"></a><h2>My faq question 2?</h2> Does it help search engines ...
3
votes
1answer
2k views

Is there a way to bulk submit URLs to Fetch as Google?

Google is taking a while to re-index changes I have made to thousands of pages, so I want to use Fetch as Google to give it a prompt. However, you can only enter 1 URL at a time as standard. Is there ...
2
votes
0answers
49 views

How come a site is indexed but not indexed? [closed]

An example URL: islamqa.info/ar The site is indexed in Google Webmaster Tools as per this image But When I use google site: operator, I get Your search - site:islamqa.info/ar - did not match any ...
3
votes
4answers
644 views

Should I use 'robots.txt' or 'sitemap.xml' to get dynamically created files indexed in search engines?

I've structure my video site like this: / (root) index.html -/videos -/video-id1 (dynamically generated subdirectory when user uploads a video) /index.html (dynamically generated file ...
0
votes
2answers
58 views

Does Googlebot (and/or search engines) index a forwarded page? [duplicate]

Let's say I have example.com domain, and I force the user to use the HTTPS over HTTP. The question is as browsers just accept and load the forwarded/new page (when the request for http://example.com ...
0
votes
3answers
53 views

Is Google indexing pages that has no connection with other pages? [duplicate]

I am working on a web project that has nearly 100 thousand instant users and there is a webpage that we are using for test cases. There are no links pointing to it from other pages. It shouldn't be ...
2
votes
1answer
225 views

Google is re-indexing pages after redirecting URLs from HTTP to HTTPS incorrectly

I upgraded my site so that all pages have gone from using HTTP to HTTPS. I didn't consider that Google treats HTTPS pages differently than HTTP. I recreated my sitemap to so that all links now ...
1
vote
2answers
124 views

What is the empirical way to tell that Google has removed a URL from the index?

After merging two sites, one with ~40 URLs and one with ~700 URLs (due to a forum) the result was that overall traffic decreased by ~50%. I want to get the traffic back, as it was organic and a ...
4
votes
3answers
3k views

Why are my posts omitted from Google search results when my site is listed in it?

My domain is not new at all, in fact I have waited for quite a long time now for Google to show some love. If I do a search for my domain name, it shows the website is listed, but if I try to search ...
0
votes
2answers
529 views

How can I remove the .html extension for static webpages that are indexed so they'll still work in a WordPress site?

I have a static HTML website with less than 100 pages and 99 of them are indexed in Google's search engine. I want to convert it into a WordPress website, but there are some problems I'm worried ...
1
vote
2answers
252 views

Allow/Make search engine to index images hosted on third party

I have my personal blog website and using Dropbox to host images (through public folders) and use them in my blog website. Is their any way to index those images in search engine like Google. I have ...
2
votes
1answer
329 views

Is there an alternative to using an iframe so that my content would be visible to search engines?

I have a book-length document that is typeset with the LaTex typesetting system (It's a markup language popular for science and math typesetting.) A custom script runs a program called HyperLatex ...
5
votes
1answer
294 views

Can Google index a non-80/non-443 URL?

Forgive me if this is a rather simple question but I have never encountered any search results before where they used a non-80 port on HTTP or non-443 port on HTTPS. Screenshots or sample of search ...
1
vote
1answer
639 views

What should I do when the maximum sitemap size limit is reached according to Google Webmaster Tools?

We have an existing sitemap with the URL: http://example.com/sitemap/sitemap.xml It was submitted to Google Webmaster Tools a long time ago and almost all the pages were indexed, but recently we ...