The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

0
votes
2answers
24 views

How to remove a page from the Google search results [duplicate]

Google says one can use the following method to remove a page from the search results: by putting -http://www.example.com/outdated.html into the sitemap. But what if the site does not exist anymore.
1
vote
2answers
14 views

Are links within SlideShare presentations indexed by search engines?

I have created a PDF presentation including links to a site I own on the last slide. So far, such links are not reported in Google Webmaster Tools. When I search Google for the presentation, I can ...
4
votes
2answers
132 views

Prevent Googlebot from seeing or indexing common keywords such as “read full story”

I have a site that uses a lot of the same anchor text. For example, "read full story". When I do an SEO audit for my site, I find that these are my most frequent keywords, but I am not trying to ...
1
vote
1answer
30 views

Would adding noindex on index.html stop main domain from being indexed?

For various reasons, I don't want my domain.com/index.html from being indexed because I have the same file with the same content but called domain.com/home.html instead. Now I added the noindex meta ...
9
votes
3answers
862 views

How do I find when an URL was first indexed by Google?

How do I find out when a particular URL was first indexed by Google? I'd prefer a solution that works even for competitors' URLs that are not owned by me.
4
votes
2answers
153 views

Number of indexed pages with “site:” search less than reported in Google Webmaster Tools

In Google webmaster tools it shows that I have 309 pages indexed, but when I search using "site:site.com" appear about 180 only (On the first page appears "about 608 results," something near the total ...
1
vote
1answer
111 views

Change to www from naked domain impact on seo

I have set up my website from the beginning to be used without the www, ie 'naked', with the following command at .htaccess and everything is working fine. RewriteCond %{HTTP_HOST} ...
2
votes
0answers
46 views

Indexing several editions of a same event [closed]

We have a website presenting sport events, mostly annual. Each URL contains the event's year and name. E.g: /marathon/my-event-2014 /marathon/my-event-2015 /marathon/my-event-2016 (the reason why ...
1
vote
1answer
40 views

Notify search engine crawlers about user generated content so that our rankings are not biased by keywords used by users

Is there a meta tag or a way to notify crawlers that a page is generated by the user? To clarify the issue, We have a website already promoted by SEO and we want to add dynamic user generated content ...
2
votes
1answer
46 views

Website not fetched by Bingbot: Unexpected Error

My website has been online for a couple years. It's on the first result for Google but it doesn't seem to be indexed by Bing. I tried to fetch it with bing in their webmaster tools and it always ...
2
votes
1answer
82 views

Is it bad to have both www and the naked domain indexed in Google? Should both be added to webmaster tools?

Currently when searching on Google, the www.example.com version will appear as opposed to example.com. I realize that isn't a big deal, however it made me wonder if I should do some of the same ...
2
votes
3answers
72 views

Having issues getting new pages indexed in Google

We are having issues getting our new pages crawled by Google and cannot figure out why. We've done lots of research and are still having trouble finding answers. Here's some information regarding our ...
2
votes
1answer
30 views

Is it unusual for Google to take more than five days to include a new site in the search index?

I recently launched a brand new website. It's a travel guide with around 260 unique pages with lots of newly written content and unique images. I submitted the site to Google 5 days ago and at the ...
3
votes
2answers
60 views

How can I get Google to index content that is written into the page with JavaScript?

I have a website that focuses on charts and graphs. The graphs on the site are drawn using JavaScript, but contain keywords that I would like to have indexed. For example, here is a screenshot of ...
1
vote
4answers
37 views

How to remove a website completely from search engine indexes except the home page?

I want to de-index all the pages of my website except home page. This is because it is an exact match domain (EMD) and I'm getting traffic on website just because of Domain name. I want to restart ...
1
vote
2answers
43 views

After the home page was redirected by a hack, it is no longer indexed. How long until it comes back?

My site was hacked, and the index page was 302 redirected. It took me a few months to get all this sorted. In the meantime, the home page lost its PageRank and was no longer included in the index. I ...
0
votes
1answer
20 views

Do bookmarks inside a document help search engines indexing content?

Say someone implements a FAQ page and decides to use bookmarks in their page, for example: <a id="Question2"></a><h2>My faq question 2?</h2> Does it help search engines ...
3
votes
1answer
315 views

Is there a way to bulk submit URLs to Fetch as Google?

Google is taking a while to re-index changes I have made to thousands of pages, so I want to use Fetch as Google to give it a prompt. However, you can only enter 1 URL at a time as standard. Is there ...
0
votes
0answers
11 views

Problem indexing my site [duplicate]

I developed a site but I've got some problems to index it. I've got 10 pages but when I search my site on google the first result is the page "contact" and not "index". I have included title and meta ...
2
votes
0answers
35 views

How come a site is indexed but not indexed? [closed]

An example URL: islamqa.info/ar The site is indexed in Google Webmaster Tools as per this image But When I use google site: operator, I get Your search - site:islamqa.info/ar - did not match any ...
3
votes
4answers
286 views

Should I use 'robots.txt' or 'sitemap.xml' to get dynamically created files indexed in search engines?

I've structure my video site like this: / (root) index.html -/videos -/video-id1 (dynamically generated subdirectory when user uploads a video) /index.html (dynamically generated file ...
0
votes
2answers
43 views

Does Googlebot (and/or search engines) index a forwarded page? [duplicate]

Let's say I have example.com domain, and I force the user to use the HTTPS over HTTP. The question is as browsers just accept and load the forwarded/new page (when the request for http://example.com ...
0
votes
3answers
42 views

Is Google indexing pages that has no connection with other pages? [duplicate]

I am working on a web project that has nearly 100 thousand instant users and there is a webpage that we are using for test cases. There are no links pointing to it from other pages. It shouldn't be ...
2
votes
1answer
113 views

Google is re-indexing pages after redirecting URLs from HTTP to HTTPS incorrectly

I upgraded my site so that all pages have gone from using HTTP to HTTPS. I didn't consider that Google treats HTTPS pages differently than HTTP. I recreated my sitemap to so that all links now ...
0
votes
2answers
49 views

What is the empirical way to tell that Google has removed a URL from the index?

After merging two sites, one with ~40 URLs and one with ~700 URLs (due to a forum) the result was that overall traffic decreased by ~50%. I want to get the traffic back, as it was organic and a ...
2
votes
3answers
354 views

Why are my posts omitted from Google search results when my site is listed in it?

My domain is not new at all, in fact I have waited for quite a long time now for Google to show some love. If I do a search for my domain name, it shows the website is listed, but if I try to search ...
0
votes
2answers
160 views

How can I remove the .html extension for static webpages that are indexed so they'll still work in a WordPress site?

I have a static HTML website with less than 100 pages and 99 of them are indexed in Google's search engine. I want to convert it into a WordPress website, but there are some problems I'm worried ...
1
vote
2answers
114 views

Allow/Make search engine to index images hosted on third party

I have my personal blog website and using Dropbox to host images (through public folders) and use them in my blog website. Is their any way to index those images in search engine like Google. I have ...
2
votes
1answer
142 views

Is there an alternative to using an iframe so that my content would be visible to search engines?

I have a book-length document that is typeset with the LaTex typesetting system (It's a markup language popular for science and math typesetting.) A custom script runs a program called HyperLatex ...
5
votes
1answer
80 views

Can Google index a non-80/non-443 URL?

Forgive me if this is a rather simple question but I have never encountered any search results before where they used a non-80 port on HTTP or non-443 port on HTTPS. Screenshots or sample of search ...
1
vote
1answer
110 views

What should I do when the maximum sitemap size limit is reached according to Google Webmaster Tools?

We have an existing sitemap with the URL: http://example.com/sitemap/sitemap.xml It was submitted to Google Webmaster Tools a long time ago and almost all the pages were indexed, but recently we ...
3
votes
7answers
80 views

Will a missing <head> tag prevent Google from indexing a WordPress site?

I was recently trying to configure a Google Webmasters Tools account for a client. I spent almost an hour wondering why I couldn't get the site to validate, when I found that the opening tag was ...
7
votes
6answers
1k views

What is Google's policy about separate content on same URLs in mobile and desktop versions?

I'm currently developing a mobile version of my site where users' devices are automatically identified and then displayed either mobile or desktop view of the same URL. For usability purposes, I ...
2
votes
3answers
130 views

Will the already indexed URLs be removed if I use a robots.txt for my site?

Many URLs from my site have been added to Google's index, but a lot of them are outdated and they will never result in a 404 error and take the user to my site's homepage. I have submitted a new ...
5
votes
5answers
371 views

How can I fix Google indexing URLs that are not part of my sitemap?

Using site:example.com in Google is returning many results with the following format: https://www.w.example.com/services/edison/16mm-to-2k Obviously this is not what I submitted and is not part of my ...
1
vote
1answer
40 views

Dynamic news showcase on homepage and impact on SEO and indexing

I want to highlight the latest news of the week or month on the homepage of my website. On another page of my site, I have a complete and comprehensive list of the news that would duplicate what is on ...
1
vote
1answer
49 views

Google not indexing new forum

We installed a new forum a few months ago now. The URL is: https://www.scirra.com/forum I've 301'd the old topics/threads, as well as included all the new URLs in the sitemap. Yet they still are ...
1
vote
3answers
72 views

How do I remove a LOT of indexed pages from Google?

A few weeks ago we have figured out that Google has indexed some information we would rather keep in some confidentiality, in the format of individual PDF files. Our assumption was that this was a ...
1
vote
1answer
31 views

Meta description of my blog post changes

I have some problems in Meta description tags in my Blogger blog. When I update my pages in search engine with the help of the Fetch as Google feature in GWT, all my blog's results comes with a ...
2
votes
2answers
27 views

How to prevent Google from indexing non-domain URL of website?

My webhost gives you two URLs for your website: the URL on your shared server, which is something like usr283725992783.webhost.com and your domain URL, which is www.example.com Google is indexing ...
10
votes
3answers
3k views

Google is still crawling and indexing my old, dummy, test pages which now are 404 not found

I have set up my site with sample pages and data (lorem ipsum, etc..) and Google has crawled these pages. I deleted all these pages and actually added real content but in webmaster tools, i still get ...
1
vote
1answer
115 views

Panda 4: Reducing #indexed pages. How much is enough?

I've been hit by panda 4 (40% decrease). I didn't see any change during panda 1-3. From what I've read it and when compared to my site, the change is probably due to the fact that I have over 30M ...
1
vote
2answers
74 views

Request Removal of naked domain from Google Index

I have a site which was temporarily available at both example.com and www.example.com. All traffic to example.com is now redirected to www.example.com, however during the brief period that the site ...
1
vote
2answers
68 views

Does Google provide different Index status for HTTP and HTTPS?

Will Google provide different index statuses for HTTP and HTTPS? Examples: http://www.example.com and https://www.example.com Or it will provide same results for both? If it doesn't provide the ...
2
votes
2answers
103 views

No description for any page on the website is available in Google despite robots.txt allowing crawling

I seem to have the weirdest issue with Search Engine Optimization, and I asked the IT folks at my university, I asked people on Joomla forums and I am trying to sort this issue out using Google ...
2
votes
2answers
56 views

Google indexing pages very slowly [duplicate]

Is there anything I can do to speed up the time it takes to index my pages? It's currently indexing them on it's own time I believe which is every 2 - 3 days and when working in music and media I need ...
1
vote
1answer
28 views

Can I redirect a new domain to a specific pg without affecting that page's search standing?

I want to redirect a new domaim (that has not been used before) to a specific page on a site which already has good standing in search results - I want to do this instead of forwarding because I need ...
8
votes
4answers
497 views

Prevent XML sitemaps from showing up in Google search results

How do I prevent my XML sitemap files from showing up in Google search results like this result of a site: search query: I don't understand why Google would choose to show sitemap files in search ...
3
votes
3answers
45 views

Indexed webpages stopped rising, while Submited keep rising normally

Last months I have noticed a strange behaviour in Google's Webmaster Tools. Although I provide a valid Sitemap for my website, which is normally processed and without any issues from Google, while ...
4
votes
3answers
140 views

Can Google Bot index transcript of YouTube hosted video?

We have a number of videos on YouTube, which we embed on our site via iframe/object stuff. Now we want to gain more SEO value by indexing video transcriptions. I have checked one of our video on ...