The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

0
votes
0answers
10 views

Having trouble with Google indexing after extending SSL cert across whole site and resubmitting sitemap

I recently extended out SSL certification to every page on my website in an effort to gain some rank. I created and claimed the new https properties (both www and non www) in Google Search Console and ...
1
vote
0answers
20 views

Index status shows significantly less pages than search results? *Not a New Site

I am trying to understand how within Google Webmaster Tools (Google Index>Index Status) I can have a figure of 2,000 total indexed pages (and falling daily) yet when I search Google using the (site:) ...
0
votes
0answers
9 views

Bingbot access urls from paypal transactions (Solved) [duplicate]

I log all transactions in the process of a paypal payment. If a user comes back from paypal, a unique token and PayerID is attached as GET query parameter by paypal. Today I noticed that bingbot ...
1
vote
1answer
35 views

Why does Google index only one of my domains even though the same site is available on several?

How can Google only index one specific domain when I have multiple domains? These domains all have same code and content. Google seems to treat the rest like they are redirected to the one domain ...
3
votes
3answers
51 views

Does Google index portions of the page that are unique and ignore the duplicate content?

When a page has content on it that is also on other pages on the site but also some unique content, how does Google handle it? Does Google: Index the entire page (including the duplicate content) ...
1
vote
3answers
47 views

Do I need two different site profiles in Google Webmasters Tools for www and non-www?

My websites are hosted on Amazon Web Services, but we moved from one physical server to another (i.e., the IP addresses changed). We were using www for our site before the new site came up. The www ...
0
votes
0answers
9 views

Spiders cannot crawl all my website pages [duplicate]

I'm struggling with googlebot webpages indexing; in particular I have a page with many links to other subpages that aren't indexed. The strange thing is that, if you submit in any online crawler the ...
0
votes
2answers
16 views

Indexing lowest number of items per page instead of indexing the view-all page

According to: https://googlewebmastercentral.blogspot.ca/2011/09/view-all-in-search-results.html, google prefers to index view-all portions of paginated content but the problem here is that my site is ...
0
votes
1answer
19 views

Should I use a canonical link which refers to the current URL in a pagination?

I know there are similar questions. But they either was not what I was looking for OR I did not understand them fully, therefore I am asking here. My situation At the moment I am using rel prev and ...
1
vote
1answer
32 views

How to permanently delete a page on your site such that search engines no longer index it?

I have a domain managed with CrownPeak. On this domain I have a page nested deeply within the site: www.example.com/exampleFolder/anotherExampleFolder/lastExample.aspx In my CMS, I've deleted the ...
0
votes
3answers
25 views

Google is indexing pages with old URLs

I run a doctor directory website. It has profile pages on individual doctors. This was the url structure: www.example.com/docprofile/23/ We recently changed the url structure to: ...
2
votes
2answers
41 views

Display short domain (country code) in the address bar while still having the site served on a global .com

I have 2 domains let say redd.it and reddit.com. Now how might I let google index the reddit.com but have users browse redd.it? The purpose of this would allow the address bar to be shorter and ...
5
votes
1answer
45 views

Google “index of” pages and “Not mobile friendly”

I noticed that in webmaster tools that Google indexed 40K of "index of" pages, ie: www.mysite.com/wp-content/uploads/.... I have lot of image galleries and they are stored by Wordpress default ...
0
votes
1answer
27 views

WordPress and Google Indexing

One of my domains i am working on, the site is using wordpress and literally a barebone site. A couple of sample pages not even an SEO plugin or site map generated as yet, why? - Well i setup the ...
0
votes
0answers
42 views

How can I know search engine bot can be visit my website?

I had some problem from my hosting, webpage is online for 1-2 month ago and completed submit to Bing webmaster tools, google and dmoz.org too. Last week don't found my website on Bing directory. I ...
3
votes
1answer
40 views

Using robots.txt to deny access to MediaWiki special pages using substring matching

I am running a Mediawiki at the domain someurl.com/wiki/. Unfortunally it generates a bunch of automatically generated Special pages which mainly are of low quality but nevertheless are massively ...
2
votes
1answer
34 views

How to index the right page?

My website is crawled and indexed by Google. However, one of my problem is that the indexed pages are sometimes not the right one. For example, let's say that I have star wars video on my website, ...
1
vote
3answers
48 views

Does Googlebot use hreflang for link discovery?

Does anyone know if Googlebot will follow and index web pages that are only listed in the head of a HTML page with a link-hreflang element? <link hreflang="fr" rel="alternate" ...
1
vote
1answer
36 views

Disable Indexing Specific Images or based on Size

I am working on a project where i need to disable specific images from indexing or based on size i need disable index from google, i am not having any idea than adding this below code in robots.txt ...
0
votes
0answers
42 views

Why is hidden content not always indexed?

I've read several blogs discussing the 'hidden content' issue. This article experimented with several options. It concludes that Google DOES index hidden content. The issues is also discussed here. ...
4
votes
2answers
432 views

Is it bad for SEO to submit a partially finished site to Google?

Hypothetical Situation 1: I have a plan for an amazing large-scale website with lot's of really cool features, animations and interactivity. This will take a several months to completely develop. ...
1
vote
0answers
22 views

How Can we index 100k+ posts efficiently? [closed]

I'm trying to index a site on google. The site has 100k+ pages in it and keeps adding up every week. What are the best ways to do it? The site is couple of months old and fairly doing good in google ...
1
vote
0answers
16 views

Is it safe to offer google a modified version of a resource if it's not to be indexed?

Currently I have it where google isn't supposed to index images on my site, and for every image request, regardless of who initiates it, the HTTP response header contains: X-Robots-Tag: noindex, ...
0
votes
0answers
32 views

URLs not allowed error for one property, but not for the other?

All of our XML sitemaps are located on another domain than the domain they're referring to, for instance: - Sitemaps would be located at sitemap-domain.com/sitemap-1.xml - URLs being referenced in ...
0
votes
0answers
18 views

What to do with my RSS sitemap & PubSubHubbub for fast URL indexation in Google?

I've read on several places, that by using Google PubSubHubbub will get the newest pages posted in RSS feeds ultra fast indexed by Google. So, I have my RSS sitemap with lots of new pages added daily ...
0
votes
0answers
23 views

Timing of Panda penalty

I found a new site (< 2 months old) with 0 PR that already has over 500,000 pages indexed according to the site: command. When I just do a google search on the domain name in quotes, there are ...
3
votes
1answer
169 views

Are text links indexed by Google?

We know that text links do not pass PageRank or signals, but say a page A contains a text link (not wrapped inside <a> </a>) to a page B and there is no other link on the net to page B and ...
0
votes
2answers
66 views

How to make Google ignore an element on a page (without using HTML comments)? [duplicate]

I would like to make Google ignore a div containing functional buttons and action titles, which I've seem come up in search engine results. Now I know about <!-- googleoff: index --> tags, ...
1
vote
1answer
43 views

SEO for short-life pages

I have website where I post offers. Those offers have short life. For example 2 days, sometimes less. I am using <expires> tag in my sitemap.xml. Is there a way, how can I programatically post ...
1
vote
0answers
29 views

How to tell search engines to not index entire image domain without making them waste server bandwidth or making google complain

From what I learned, there's one way I could cause all URLs on a domain strictly serving images not to be indexed and that is with the x-robots-tag HTTP header. Now I check my logs and find out that ...
2
votes
1answer
32 views

deindexing a whole domain with robots.txt created problems in google webmaster tools

In my robots.txt for my domain that just hosts images, I used the following lines: user-agent: * noindex: / I thought I was doing search engines a wonderful favor by not having them crawl through ...
1
vote
1answer
33 views

Preventing some parts of the pages of a site from being indexed [duplicate]

My website has links like: <a href="messages.aspx">Messages<span>3</span></a> Well google indexes these links as: Messages3 I have read some articles for preventing google ...
2
votes
0answers
40 views

Indexing protected PDF files

It is my intention to use protected PDF files on my web journal, the type that does not allow the text to be copied. I would like to know if this will affect its indexing on Google Scholar, and if ...
2
votes
1answer
50 views

Making one image non-indexable to search engines in webpage

On my contact page, its a form where people can select a department to contact, then they fill out basic information (name, email and message). Additionally, a PHP script is called (via the HTML IMG ...
1
vote
2answers
60 views

Website restructuring, 301 redirect or complete de-index?

I am managing an e-store site created by another colleague, that was badly created from the start. Because of the structure, pagination and user browser capabilities combined with lack of meta robots ...
3
votes
1answer
44 views

Does using the noarchive tag affect the page rankings?

Has anyone heard of any ranking impact for the pages where the noarchive tag is used? They are indexable (and indexed), but just wondered if there are any case studies showing that disallowing Google ...
0
votes
1answer
58 views

Schema.org markup taking too long to index

I run a doctor discovery platform. It has individual profiles for each doctor (over 700 profiles). I've added schema markup to the profiles. It's been more than 5 months and still not all the ...
2
votes
1answer
38 views

Dynamic Serving: Verifying which version of the page Google is showing on Mobile SERPs

We have a large content/informational site which serves pages dynamically based on user device (the same URL for both desktop and mobile). Title tags for mobile pages do not match those set for ...
3
votes
1answer
90 views

Stop Google from indexing parent folder URLs

Here is my problem: example.com/images folder and subfolders contain all of my images for example.com site and sub pages. Google is indexing those directories locations as URLs. For example. ...
0
votes
3answers
63 views

Search Console shows 343 web pages submitted but only 132 indexed

My Search Console (Webmaster Tools) account shows 343 web pages submitted but only 132 indexed. The actual number of posts on my blog are 138. What should I do? I am also getting 179 "not found" ...
1
vote
0answers
57 views

Why is my Angular App in HTML5Mode not being indexed by Google?

My Angular App is not being indexed by Google and I don't know why. All the solutions I could find only work with #!-URL's, snapshots and middleware but my App uses HTML5Mode and #-URL's for older ...
1
vote
1answer
74 views

How can I force AOL to index the site?

My site is fully indexed by Google, but particularly not by AOL. What can I do to force AOL to index it all? I have read a lot of info that AOL uses Google database. The site is submitted to Google ...
2
votes
5answers
588 views

How to make whole site headers send code 404?

I have a website for testing. I don't want this site to be indexed by search engines. Now pages on the site return 200 OK in headers. How to make the whole site send code 404 in headers, but stay ...
2
votes
1answer
215 views

What are the htaccess mechanics of preventing search engines from indexing PDF files?

There are already a variety of posts on how to block certain files (in my case, PDFs) from a search engine like Google. The most relevant for this post was here: How to protect PDF file from indexing. ...
0
votes
1answer
18 views

Removing/Adding Google Listings

I have a site with user generated pages where the user can make their page "published" or "unpublished". My problem is, their pages are often indexed high on Google (usually in the top 3) and so when ...
3
votes
1answer
71 views

Replace all images when search engine crawler visits site

I have written code that will detect when a user is a search engine and i dont include css files when this happens to save bandwidth. I was also thinking i could replace ALL images on the page with a ...
2
votes
2answers
59 views

Removed parent category path - New URL's not showing up in Google search results

Last month we removed parent category path from the sub category URL's. After that we changed the sitemap file with new URL's and submit it to the webmaster tools for indexing. For example ...
0
votes
1answer
89 views

Is it possible to get URLs with parameters not indexed by Google if they contain hashtags?

Some sources say to use # before the parameters in URL, others recommend using #! or !#... So, if I'm using category filters on a page, to add parameters to URLs and sort items based on price, color ...
1
vote
3answers
73 views

How to Re-Crawl My Website on Google?

I have one issue with my website. When I updated the meta title and description the first time, everything was fine and Google crawled the website within 24 hours. But now due to some keyword ...
1
vote
1answer
90 views

Noindex metatag in alternate mobile version of page with canonical to desktop… What consequences?

I have a desktop site to serve content for desktop and tablet users. I also have a mobile version of the site to cater to mobile phone visitors. Desktop pages have the following kind of annotations ...