The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

learn more… | top users | synonyms

0
votes
0answers
23 views

Timing of Panda penalty

I found a new site (< 2 months old) with 0 PR that already has over 500,000 pages indexed according to the site: command. When I just do a google search on the domain name in quotes, there are ...
3
votes
1answer
174 views

Are text links indexed by Google?

We know that text links do not pass PageRank or signals, but say a page A contains a text link (not wrapped inside <a> </a>) to a page B and there is no other link on the net to page B and ...
0
votes
2answers
82 views

How to make Google ignore an element on a page (without using HTML comments)? [duplicate]

I would like to make Google ignore a div containing functional buttons and action titles, which I've seem come up in search engine results. Now I know about <!-- googleoff: index --> tags, ...
1
vote
1answer
47 views

SEO for short-life pages

I have website where I post offers. Those offers have short life. For example 2 days, sometimes less. I am using <expires> tag in my sitemap.xml. Is there a way, how can I programatically post ...
1
vote
0answers
41 views

How to tell search engines to not index entire image domain without making them waste server bandwidth or making google complain

From what I learned, there's one way I could cause all URLs on a domain strictly serving images not to be indexed and that is with the x-robots-tag HTTP header. Now I check my logs and find out that ...
2
votes
1answer
36 views

deindexing a whole domain with robots.txt created problems in google webmaster tools

In my robots.txt for my domain that just hosts images, I used the following lines: user-agent: * noindex: / I thought I was doing search engines a wonderful favor by not having them crawl through ...
1
vote
1answer
38 views

Preventing some parts of the pages of a site from being indexed [duplicate]

My website has links like: <a href="messages.aspx">Messages<span>3</span></a> Well google indexes these links as: Messages3 I have read some articles for preventing google ...
2
votes
1answer
48 views

Indexing protected PDF files

It is my intention to use protected PDF files on my web journal, the type that does not allow the text to be copied. I would like to know if this will affect its indexing on Google Scholar, and if ...
2
votes
1answer
74 views

Making one image non-indexable to search engines in webpage

On my contact page, its a form where people can select a department to contact, then they fill out basic information (name, email and message). Additionally, a PHP script is called (via the HTML IMG ...
1
vote
2answers
70 views

Website restructuring, 301 redirect or complete de-index?

I am managing an e-store site created by another colleague, that was badly created from the start. Because of the structure, pagination and user browser capabilities combined with lack of meta robots ...
3
votes
1answer
62 views

Does using the noarchive tag affect the page rankings?

Has anyone heard of any ranking impact for the pages where the noarchive tag is used? They are indexable (and indexed), but just wondered if there are any case studies showing that disallowing Google ...
0
votes
1answer
93 views

Schema.org markup taking too long to index

I run a doctor discovery platform. It has individual profiles for each doctor (over 700 profiles). I've added schema markup to the profiles. It's been more than 5 months and still not all the ...
2
votes
1answer
44 views

Dynamic Serving: Verifying which version of the page Google is showing on Mobile SERPs

We have a large content/informational site which serves pages dynamically based on user device (the same URL for both desktop and mobile). Title tags for mobile pages do not match those set for ...
3
votes
1answer
108 views

Stop Google from indexing parent folder URLs

Here is my problem: example.com/images folder and subfolders contain all of my images for example.com site and sub pages. Google is indexing those directories locations as URLs. For example. ...
1
vote
3answers
98 views

Search Console shows 343 web pages submitted but only 132 indexed

My Search Console (Webmaster Tools) account shows 343 web pages submitted but only 132 indexed. The actual number of posts on my blog are 138. What should I do? I am also getting 179 "not found" ...
1
vote
0answers
62 views

Why is my Angular App in HTML5Mode not being indexed by Google?

My Angular App is not being indexed by Google and I don't know why. All the solutions I could find only work with #!-URL's, snapshots and middleware but my App uses HTML5Mode and #-URL's for older ...
1
vote
1answer
102 views

How can I force AOL to index the site?

My site is fully indexed by Google, but particularly not by AOL. What can I do to force AOL to index it all? I have read a lot of info that AOL uses Google database. The site is submitted to Google ...
2
votes
5answers
593 views

How to make whole site headers send code 404?

I have a website for testing. I don't want this site to be indexed by search engines. Now pages on the site return 200 OK in headers. How to make the whole site send code 404 in headers, but stay ...
2
votes
1answer
323 views

What are the htaccess mechanics of preventing search engines from indexing PDF files?

There are already a variety of posts on how to block certain files (in my case, PDFs) from a search engine like Google. The most relevant for this post was here: How to protect PDF file from indexing. ...
0
votes
1answer
19 views

Removing/Adding Google Listings

I have a site with user generated pages where the user can make their page "published" or "unpublished". My problem is, their pages are often indexed high on Google (usually in the top 3) and so when ...
3
votes
1answer
72 views

Replace all images when search engine crawler visits site

I have written code that will detect when a user is a search engine and i dont include css files when this happens to save bandwidth. I was also thinking i could replace ALL images on the page with a ...
1
vote
2answers
61 views

Removed parent category path - New URL's not showing up in Google search results

Last month we removed parent category path from the sub category URL's. After that we changed the sitemap file with new URL's and submit it to the webmaster tools for indexing. For example ...
0
votes
1answer
121 views

Is it possible to get URLs with parameters not indexed by Google if they contain hashtags?

Some sources say to use # before the parameters in URL, others recommend using #! or !#... So, if I'm using category filters on a page, to add parameters to URLs and sort items based on price, color ...
1
vote
3answers
86 views

How to Re-Crawl My Website on Google?

I have one issue with my website. When I updated the meta title and description the first time, everything was fine and Google crawled the website within 24 hours. But now due to some keyword ...
1
vote
1answer
112 views

Noindex metatag in alternate mobile version of page with canonical to desktop… What consequences?

I have a desktop site to serve content for desktop and tablet users. I also have a mobile version of the site to cater to mobile phone visitors. Desktop pages have the following kind of annotations ...
0
votes
1answer
98 views

Trick to index infinite scroll content on Google?

I have a Question & Answer website, sort of like stackoverflow. When you open it, it displays 20 latest questions. When scroll to bottom of page, and it fetches 20 more, and so on, infinitely. ...
2
votes
1answer
624 views

Does Bing execute Javascript when crawling and indexing web pages (like Google)?

Some content on some web pages is only displayed with Javascript when a button is clicked (for example). We know that Google executes Javascript and is (very likely) to find this content, but what ...
1
vote
1answer
28 views

Submit a new site description into Google

Google indexed my site in a moment where I had the wrong content, and the search results currently show a "Loren Ipsun" text as my site description. How can I re-submit the description of my site to ...
2
votes
2answers
186 views

How to see which images Google has indexed from your website?

Ive got a website that is using lazy loading to load in images (so that the browser dose not try and load them all at once before they are required). The only issue with this is that there are some ...
0
votes
1answer
20 views

Testing server indexed in Google [duplicate]

Assume our website domain to be www.example.com. And we have created a separate testing environment within our main domain: Say : www.project.example.com. So we have two versions within our main ...
0
votes
1answer
57 views

Crawl errors for pdf download links in my website

We are building a local business classified website which has about 6000 unique listingsunder huge number of categories and sub-categories. For each listing there is a details page in which we have ...
1
vote
3answers
76 views

Preserving search engine rankings when old domain name is lost

We have a client with the unfortunate situation of losing access to their current domain name "A". We've just finished finished setting their website up on domain "B". Both websites on "A" and "B" ...
0
votes
0answers
13 views

Shall i make mobile version of my website indexed by search engines? [duplicate]

I have a website with a separate version for mobile and smart phones but the user cannot open the mobile version from Desktop and vise versa the Desktop version cannot opened from Mobile device(s). ...
2
votes
0answers
164 views

Google shows different results for my brandname in their SERP

When I typed site:example.com in Google's search box, it's displaying a different title and meta description, but the thing puzzling me is the site URL is being displayed correctly and redirected to ...
5
votes
3answers
298 views

For webpages using jQuery, will the Googlebot index them on “page load” or after the “page ready” state?

Will the Googlebot index a webpage on "page load" or after the "page ready" state. The reason I'm asking is because I'm trying to change my h1 and h2 tags using jQuery on page Load.
0
votes
0answers
6 views

My new website doesn't show up in Google search [duplicate]

My new website went online almost a month, but still nothing show up in Google search. Google has indexed my website in webmaster tools and sitemap, but do not show any results in search, even I ...
2
votes
2answers
129 views

robots meta not blocking indexing

We have a staging version of our website to test changes on at trailheadpaddleshack.ca/staging1. This never appeared in search before. Recently the staging site has appeared on Google and is affecting ...
4
votes
3answers
369 views

How do I prevent Google from indexing text that is generated by JavaScript?

Google is executing the JavaScript on my password creator website and indexing the random passwords that get generated by the JavaScript. The random text that is generated could look spammy to ...
0
votes
1answer
103 views

Allow Google to index page loaded by Ajax, but link to parent page

I have a website with a page with 10 tabs, each tab's contents is loaded by AJAX. I would like Google to index the content of the tabs (loaded by AJAX), but Google should allow links ONLY to the ...
2
votes
0answers
39 views

Webpages being de-indexed seemingly for no reason [duplicate]

Last Wednesday my site had a ton of its paged de-indexed by Google and it's caused a drop of over 60% in overall site traffic :(... One of the pages used to rank first page #1-3 and now it doesn't ...
7
votes
3answers
68 views

Is there a way to show Google and other robots a URL to original-sized image without anchor?

Let's assume I have an image. <img src="book_thumb.jpg"> And I want it to be indexed in Google and other search engines, but in its normal size, not as a thumbnail. So I just want Google to ...
1
vote
1answer
104 views

How to stop beta websites indexing in Google Search? [duplicate]

I want stop my beta.example.com being indexed by search engines, because it can generate duplication issue.
0
votes
1answer
39 views

Does the following robots.txt block all pages

I want to knew if the following robots.txt file block the whole pages from being indexed or not. User-agent: * Disallow: Disallow: /cgi-bin/
1
vote
2answers
134 views

How can I submit my site's URL to search engines?

I have a site but I cannot get its URL indexed in search engines like Google, Yahoo, Bing, etc... Please let me know how I can submit my site's URL to Google.
1
vote
2answers
531 views

Google is indexing pages with a “noindex” robots meta tag

I have come across a very annoying problem. I have several pages that shouldn't be indexed, as they are basically pop-up pages and "thanks for signing up" pages. I have set them up with the robots ...
0
votes
0answers
139 views

How long does it take to re-index the website via noarchinve tag?

I read elsewhere on here that one can't re-index their site with google, but I like to challenge that. Currently, I have every page on my website (that contains about 1,000,000 pages) labeled with a ...
1
vote
2answers
78 views

Google Site: listing Parent Domain directory Index

Currently when we search site:domain.com on google we get a return of 3.6 million pages indexed, About 3,650,000 results (0.31 seconds). When we search site:domain.com/childdirectory we get 3.8 ...
1
vote
2answers
358 views

Conflicting test results when using The Mobile-Friendly Test and PageSpeed Insights

Our website uses an open source product to detect user agent and based on that, it servers mobile theme or desktop theme to users. I know the exact difference between mobile-friendly test and ...
1
vote
1answer
26 views

Changing headers for small screens - SEO implications

I'm changing some of my pages to better display in different devices (tables, smart phones etc). I want to figure out a good way of handling headings. So far my options are hide headings for small ...
2
votes
1answer
104 views

X-Robots noindex a folder of PDFs

I'd like to noindex a group of PDFs within a certain folder. There are other PDFs on site that I do want indexed, so I want to avoid using <FilesMatch ".pdf$"> Header set X-Robots-Tag "noindex, ...