Questions tagged [search-engine-indexing]

The process of recording where particular words occur. In the web context search engines crawl the web and make a list of which pages have particular words - this is the index.

Filter by
Sorted by
Tagged with
37 votes
5 answers
3k views

Why isn't my website in Google search results? [duplicate]

It's been sometime and Google has yet to index my site. How can I get Google to index my website?
aneuryzm's user avatar
  • 1,897
34 votes
5 answers
90k views

How to prevent a PDF file from being indexed by search engines?

I have a link to PDF document on a public web-page. How do I prevent search engines from indexing this link and PDF document? The only idea I thought of is to use CAPTCHA. However, I wonder if ...
user avatar
33 votes
3 answers
7k views

Why aren't search engines indexing my content?

This is a general, community wiki catch-all question and answer pair intended to address any questions concerning the reasons a site or specific site contents do not appear in search engine ...
30 votes
4 answers
14k views

Prevent XML sitemaps from showing up in Google search results

How do I prevent my XML sitemap files from showing up in Google search results like this result of a site: search query: I don't understand why Google would choose to show sitemap files in search ...
Stephen Ostermiller's user avatar
28 votes
5 answers
4k views

Page appears indexed in Google but not findable for any search terms?

(Note that I am going to use screenshots here because I suspect writing about this will change the behavior over time.) If you do a Google search for uiviewcontroller best practices either with ...
Jeff Atwood's user avatar
  • 13.9k
23 votes
2 answers
14k views

Do search engines index text contained in SVG elements?

Example: <svg><text>Hello World</text></svg>?
paragooon's user avatar
  • 415
21 votes
13 answers
3k views

How do I get images containing text to be indexed by search engines?

I am building a small portfolio website for a friend, and being in advertising and all, she hates the standard fonts and wants everything written in a custom font. As CSS font-embedding is not really ...
Wookai's user avatar
  • 1,607
21 votes
3 answers
24k views

Google is still crawling and indexing my old, dummy, test pages which now are 404 not found

I have set up my site with sample pages and data (lorem ipsum, etc..) and Google has crawled these pages. I deleted all these pages and actually added real content but in webmaster tools, i still get ...
Ace's user avatar
  • 373
19 votes
4 answers
40k views

How do I find when an URL was first indexed by Google?

How do I find out when a particular URL was first indexed by Google? I'd prefer a solution that works even for competitors' URLs that are not owned by me.
matcheek's user avatar
  • 197
17 votes
6 answers
12k views

How to get tens of millions of pages indexed by Google bot?

We are currently developing a site that currently has 8 million unique pages that will grow to about 20 million right away, and eventually to about 50 million or more. Before you criticize... Yes, it ...
Chris Adragna's user avatar
16 votes
2 answers
6k views

Indexing for Google scholar, which tags to use?

In the "Inclusion Guidelines for Webmasters" for Google Scholar is written under Indexing Guidelines: Google Scholar supports Highwire Press tags (e.g., citation_title), Eprints tags (e.g., eprints....
Peter Smit's user avatar
15 votes
3 answers
3k views

How does Google find a domain with no links to it?

I recently registered a new domain, pointed it to my existing server, and set up a minimal page just saying "test" and nothing else. I just discovered tonight that the page is already indexed in ...
DisgruntledGoat's user avatar
15 votes
3 answers
5k views

Number of indexed pages with "site:" search less than reported in Google Webmaster Tools

In Google webmaster tools it shows that I have 309 pages indexed, but when I search using "site:site.com" appear about 180 only (On the first page appears "about 608 results," something near the total ...
FPSxploit's user avatar
  • 165
14 votes
4 answers
3k views

How can I get Google to index my PDF documents?

We are having troubles getting Google to index the PDF files in our site. There are about 50 PDF and range in size for 20 KB to a little under two megs. They are not protected, can be read ...
user avatar
13 votes
3 answers
6k views

Can you use googleon and googleoff comments to prevent Googlebot from indexing part of a page?

I've seen code like for preventing Google from indexing part of a page: <p>This is a paragraph that will be indexed by Google.</p> <!--googleoff: index--> <p>This is a ...
Stephen Ostermiller's user avatar
13 votes
5 answers
1k views

Is there any way to have search engines not index a certain section of a page?

I have Blogger setup with the Blog Archive panel shown on every page so that users can easily get to old posts. The problem is that it lists the title of each page in this panel, meaning that the ...
Senseful's user avatar
  • 825
11 votes
2 answers
3k views

Does Google submit HTML forms?

I have a web page, say http://domain/purchase and in this page, I have a web form. User, on submitting this form (which has validation, both client-side and server side and won't be validated until ...
Saeed Neamati's user avatar
10 votes
8 answers
9k views

How long did it take for your new website to be indexed by search engines [duplicate]

Possible Duplicate: Why isn't my website in Google search results? I have added my website to the webmaster tools of some major search engines already, and supplied the sitemap for the ...
9 votes
2 answers
343 views

Is using URL rewritting instead of multiple parameters the only way to make sure all pages are indexed by Google?

If I keep the pattern (index.php?module=test&param=1) will pages be less likely to be indexed then if I use the pattern (test_param_1.html) ?
HoLyVieR's user avatar
  • 755
9 votes
3 answers
3k views

"X-Robots-Tag: noindex" on an HTTP 301 response

I understand that a resource with X-Robots-Tag: noindex forces some search engines, including Google, not to index the resource further. I also understand that an HTTP 301 response causes search ...
Peter O.'s user avatar
  • 191
8 votes
6 answers
5k views

What is Google's policy about separate content on same URLs in mobile and desktop versions?

I'm currently developing a mobile version of my site where users' devices are automatically identified and then displayed either mobile or desktop view of the same URL. For usability purposes, I ...
Kasperi's user avatar
  • 183
8 votes
5 answers
1k views

Is it worthwhile to pay for boosting SEO for a new wesite?

I have come across a couple of websites today that claim to boost your website index in a matter of days. There are 1000s of reviews and all of them seem quite positive showing off results and stuff. ...
user1889580's user avatar
8 votes
3 answers
2k views

How do I prevent Google from indexing text that is generated by JavaScript?

Google is executing the JavaScript on my password creator website and indexing the random passwords that get generated by the JavaScript. The random text that is generated could look spammy to Google ...
Stephen Ostermiller's user avatar
8 votes
5 answers
2k views

Is it possible to 'trigger' indexing on a site?

We're launching a redeveloped site soon. Google has already indexed the site that we're going to replace, but the links that google indexed are no longer applicable, because the new site has a totally ...
DaveDev's user avatar
  • 213
8 votes
4 answers
2k views

Could a brand name called "Error 404" cause SEO issues?

This is a strange question, but I really struggled to find any decent info by searching for it. I have a client who has a new e-commerce product collection called "Error 404", and they want ...
Cam Parry's user avatar
8 votes
1 answer
130 views

How to tell which URLs have fallen out of search engine index

I've had a few pages trimmed from google's indexed number on my sitemap in webmaster tools. How can I tell which pages have been dropped?
JMC's user avatar
  • 3,280
7 votes
2 answers
15k views

Is there a way to bulk submit URLs to Fetch as Google?

Google is taking a while to re-index changes I have made to thousands of pages, so I want to use Fetch as Google to give it a prompt. However, you can only enter 1 URL at a time as standard. Is there ...
Newmania's user avatar
  • 173
7 votes
3 answers
90 views

Is there a way to show Google and other robots a URL to original-sized image without anchor?

Let's assume I have an image. <img src="book_thumb.jpg"> And I want it to be indexed in Google and other search engines, but in its normal size, not as a thumbnail. So I just want Google to ...
Damian's user avatar
  • 71
7 votes
2 answers
5k views

Redirecting robots.txt when moving to a new domain

I'm moving a site to a new domain, to a local tld. I already redirected everything successfully to the new domain, except the robots.txt. My question would be that is it needed to redirect the ...
rihekopo's user avatar
  • 347
7 votes
2 answers
2k views

Index the content within an iframe

We have created an web application that gives the client the possibility to use his websites as an online showroom (cars, bikes, etc etc). What is offered is photo's, information about the vehicles ...
Desley Roelofsen's user avatar
7 votes
3 answers
6k views

Can a sitemap index file reference sitemap files under different domains?

My company owns several domain names. We also host websites for our users at their custom domains. Our domains: company.com product1.com product2.com Users's domains: user1.com user2.com ...
Jesse Webb's user avatar
7 votes
3 answers
439 views

Best approach to have Google index content primarily generated by Javascript

I'm developing an app where customers can drop in a Javascript tag onto their website, and it will generate content. What is the best approach to have Google index this content and associate it with ...
user avatar
7 votes
5 answers
294 views

Is it positive or negative for the average website to allow search engines to index user comments?

I've been trying to answer this question myself by researching and searching on google but I haven't been able to come with a final answer. I have some hypothesis I would like share anyway: The ...
Jose Cano's user avatar
7 votes
1 answer
322 views

Do the <detail> and <summary> HTML tags which hide text until clicked have any effect on SEO?

For example: <details> <summary> short summary </summary> long details </details> Will Google treat "long details" normally or will it ...
IMB's user avatar
  • 309
7 votes
1 answer
1k views

Index status shows significantly less pages than search results? *Not a New Site

I am trying to understand how within Google Webmaster Tools (Google Index>Index Status) I can have a figure of 2,000 total indexed pages (and falling daily) yet when I search Google using the (site:) ...
user9722's user avatar
  • 233
7 votes
3 answers
2k views

For webpages using jQuery, will the Googlebot index them on "page load" or after the "page ready" state?

Will the Googlebot index a webpage on "page load" or after the "page ready" state. The reason I'm asking is because I'm trying to change my h1 and h2 tags using jQuery on page Load.
maheshwaghmare's user avatar
6 votes
5 answers
6k views

Huge drop off in Google "indexed" pages after switching to HTTPS, should I switch back to HTTP?

I did a full redesign of my website to make it responsive (bootstrap), added localization, and also switched the whole website to use HTTPS. My website use to default to http://www.domain.com/ and ...
olimits7's user avatar
  • 213
6 votes
2 answers
3k views

Why doesn't searching for the unique name of my website bring the site up in a top position on Google?

I have a website with a unique name, already indexed and with a perfect SEO. Although there are no websites with the same unique name, when I'm searching on Google I found my homepage listed on the ...
NineCattoRules's user avatar
6 votes
2 answers
6k views

Why the number of indexed pages decreased for a "site:" search

Recently I created a website with hundreds of thousands of unique pages. A week ago, Google had indexed about 250,000 pages. It has now decreased to 90k URLs (using a site:domain.com query). What ...
Parthipan Paramasivam's user avatar
6 votes
3 answers
3k views

How long does it take for Google Webmasters to index site after submiting sitemap? [duplicate]

Possible Duplicate: Why isn't my website in Google search results? I have submitted my website's sitemap to webmaster's tools. The status on the sitemap says OK and it shows that 12 URLs ...
user avatar
6 votes
5 answers
9k views

Why are URLs with my domain name at the end showing up in analytics?

I have a multi-language WordPress site that has been live since the last 3 months and today when I checked Analytics, I saw a lot of weird URLs: /menswear-fashion-autumn-winter-2013-2014/www.domain....
Amit Erandole's user avatar
6 votes
2 answers
401 views

Is content inside IE conditional comments indexed by search engines?

Although I'm aware of the various methods to show content only to users of a specific IE version, I was wondering if using conditional comments would have an effect on the way my site is indexed. If I ...
Mog's user avatar
  • 405
6 votes
6 answers
11k views

How can I get a list of all indexed pages for my domain?

We're in the process of migrating an outdated e-commerce cart to Magento. Part of this process will entail configuring proper 301 redirects. I'm aiming to get a list of all indexed pages to throw ...
JR.XYZA's user avatar
  • 63
6 votes
2 answers
4k views

Is setting the width and height of an SVG important for indexing?

Generally, when SVGs are displayed responsively, we only need to set the viewBox attribute on the <svg> and can entirely omit the width and height attributes (i.e. something like <svg viewBox=...
cute_ptr's user avatar
  • 189
6 votes
1 answer
195 views

Google CSE has indexed robots.txt itself

Google CSE has indexed robots.txt and now if someone searches for 'txt' it returns the robots.txt file which is really not ideal (as this is a bog-standard Drupal site, the string robots.txt actually ...
chx's user avatar
  • 163
6 votes
2 answers
2k views

Delivering a different version of website to Google robots (SSR)

I am working on an enterprise website project as an SEO manager. They were using Angular.js by now but I made them switch to SSR (server-side rendering) since Google robots were not able to render the ...
Shayan Davoodi's user avatar
6 votes
1 answer
1k views

Best way to let Google index page with tabs - SEO

Let' say I have a /pets page with 4 tabs on it: All Dogs Cats Owls The All tab displays all the pets on page load. Each of the 3 other tabs holds a list of dogs/cats/owls, respectively - loaded ...
lesssugar's user avatar
  • 233
6 votes
2 answers
2k views

Can Google index a non-80/non-443 URL?

Forgive me if this is a rather simple question but I have never encountered any search results before where they used a non-80 port on HTTP or non-443 port on HTTPS. Screenshots or sample of search ...
Jürgen Paul's user avatar
6 votes
4 answers
931 views

Will JavaScript (document.write) content be indexed by search engines?

I have an external JS file embedding some content inline in a web page. Basically it just does a document.write("my content") via a script tag and loaded externally with the src attribute. Any ...
Clément's user avatar
  • 163
6 votes
2 answers
147 views

I'm being outranked by iframe of my ownsite

My website is being outranked by another third party website through an iframe of my website. Their website is featuring my website through an iFrame on a basic page. This page consists of a header, ...
lastditcheffort's user avatar

1
2 3 4 5
19