Tag Info

Hot answers tagged

17

There are a number of reasons your content may not appear in search engine results, however, it is important to note that a search engine's index may contain pages that it doesn't display in its results page. How to tell if your content is actually indexed It may actually be difficult to tell if your content is indexed. Search for all the documents from ...


16

EMBED THE FONTS! No, but really, Embeddable fonts work on all current browsers (FF, Chrome, Safari, Opera) and IE5.5+ (yes, it's been working in IE since the 90s.) Get your TTF upload it here: http://www.kirsle.net/wizards/ttf2eot.cgi It'll give you the code and 2 files back (a TTF and then an EOT[M$ web font]) back. Copy, paste, upload, done. Win win! ...


13

To prevent your PDF file (or any non HTML file) from being listed in search results, the only way is to use the HTTP X-Robots-Tag response header, e.g.: X-Robots-Tag: noindex robots.txt does not prevent your page from being listed in search results. What it does is stop the bot from crawling your page, but if a third party links to your PDF file from ...


12

Some potential strategies: Google Webmaster Tools allows you to request an increased crawl rate. Try doing that if you haven't already. Take another look at your navigation architecture to see if you can't improve access to more of your content. Look at it from a user's perspective: If it's hard for a user to find a specific piece of information, it may be ...


11

There's not much you can do about this. There's a teensy bit you can do to help, but the problem is endemic to Google's index. There isn't just one Google "index;" it's sharded. Pages with low PageRank appear in very few shards. Using site:stackoverflow.com forces your query onto a shard that has a larger fraction of your URLs indexed. That explains the ...


8

A similar question was asked on Stack Overflow back in January. John Mueller was kind enough to respond with the following: "googleon" and "googleoff" are only supported by the Google Search Appliance (when you host your own search results, usually for your own internal website). They are not supported by Google's web-search at all. As far as ...


8

The best course of action is to use canonical URLs. This avoids a situation where you are penalized for duplicate content. When it comes to desktop vs mobile websites, most sites will have something like this on their mobile website: Example for: http://m.mywebsite.com/page.html <link rel="canonical" href="http://mywebsite.com/page.html" /> The ...


7

No, URL rewriting has no positive influence on crawling or indexing; oftentimes it can even have a negative effect. For instance, many websites embed all parameters as well as plain text (eg the "title") in the URL when rewriting them, creating pages with many possible URLs (we often even see session-IDs rewritten in URLs...). We did a blog post on this at ...


7

I do not believe Google says. It used to be true that test_param_1.html was better than index.php?module=test&param=1 but I do not believe that is the case anymore for Google. However, if your 2 examples pages are very similar in content then you will want to use a rel canonical on them so Google knows which one is the master. Otherwise your pagerank ...


7

Yes You can now use Google search to find SVG documents. SVG is an open, XML-based format for vector graphics with support for interactive elements. We’re big fans of open standards, and our mission is to organize the world’s information, so indexing SVG is a natural step. We index SVG content whether it is in a standalone file or embedded ...


7

Google has been able to crawl HTML forms since 2008. Having chosen the values for each input, we generate and then try to crawl URLs that correspond to a possible query a user may have made. If we ascertain that the web page resulting from our query is valid, interesting, and includes content not in our index, we may include it in our index much as we ...


7

Technically speaking http://www.new.com/tag/relationships and http://www.new.com/tag/relationships/ are two different pages just like http://www.example.com/ and http://www.example.com/index.html are two different pages even though they pull up the same page. To make sure the search engines understand that http://www.new.com/tag/relationships and ...


7

Robots.txt just tells search engines not to crawl your pages. It does not tell them to not index your pages. So if your pages have links from other websites the search engines will know they exist. And because off-page factors affect rank, sometimes greatly, your pages can rank well for long-tail search terms without ever being crawled. To actually prevent ...


7

Okay. First things first. Do not mark your 404 as being fixed. You are actually prolonging the issue. Google will try and fetch a page that returns a 404 several times before giving up. This is because the 404 error indicates a temporary situation where a 410 error says the page is gone. So every time you mark a 404 as being fixed, you are in effect telling ...


7

In my experience, mobile visitors want the same content as your desktop visitors do. I worked for a travel website with lots of information about hotels and restaurants. The site is generally known for hotels, but we thought that mobile users would be much more interested in restaurant content because they we looking for something when they were out. ...


6

Supposedly you can add the class robots-nocontent to elements on your page, like this: <div class="robots-nocontent"> <p>Ignore this stuff.</p> </div> Yahoo respects this, though I don't know if other search engines respect this. It appears Google is not supporting this at this time. I suspect if you load your content via ...


6

Create a Webmasters Account from Google, here http://www.google.com/webmasters/. Once you have an account you can attach it to the website in question by putting a file into the root folder of your site. Google will then recognize that you as the owner of the Webmaster account also own/control the site in question. Once you have done this Google will ...


6

Unless she is selling her own fonts on this website, I think you both could work more on CSS embedding (yeah, I read this is not an option for you now, but I insist). If the case is a heavier graphic work upon fonts (gradient colors, twisted alignment, glossing, embossing, engraving...), making it really impossible to render thorugh CSS options as she ...


6

Eprints tags are used in the EPrints academic repository software. BE Press tags are used in The Berkley Electronic Press SelectedWorks product. Neither offers documentation on their proprietary meta tags that I could find. You can, however, view the source of any HTML page generated by an Eprints or SelectedWorks server to see their metadata tags in use. ...


6

IE conditional comments are just a special kind of HTML comments. It is accepted that search engines do not index or give any weight to content in HTML comments. From a StackOverflow answer where they give a quote from Matt Cutts: I believe that we have the ability to index them, but we usually don't index comments.


6

If it's a HTML document, include the following meta tag in it: <meta name="robots" content="noindex" /> This will tell Google and every other search engine that understands the tag (which should be pretty much all of them, since it's been around since 1996) not to index the page. For non-HTML documents, you can configure your webserver to send the ...


6

The best way is to use 301 redirects in your .htaccess file, the 301 code signals to google that the url has been permanently redirected. I'd also recommend signing up for Google Webmaster Tools and submitting a sitemap to them, if you haven't already, as this will help them to understand the changes you're making to your site. redirect 301 /old-url ...


6

Wordpress is set to ping Google whenever you write a new post. From http://wordpress.org/support/topic/google-blog-pinging Settings->Writing. At the bottom you'll find a list of "Update Services". The default is to ping the pingomatic server, which then pings a dozen or more other places for you, Google included. However, if you want to ping Google ...


6

Your site needs to have something, be it content or functionality that differentiates it from the other sites on the internet. Here are some examples. The internet doesn't need yet another site that... ...publishes the text of the Bible. That is, unless your site does it better than all the others with unique insight, commentary, or even a novel way ...


6

Google does appear to index XML sitemaps (like any XML file). It seems that if Google is aware of a URL and it returns a valid response then it's likely to get indexed. Personally, I only submit the sitemap through GWT and include a Sitemap: reference in robots.txt and this is certainly enough to get it indexed. I believe the recommended method to prevent ...


6

Most likely some part of your web site generated links like that, and that is how Google started to crawl the URLs. You should check the links in your web pages to see where these incorrect URLs are, and you should fix them. Also, you could change your Apache configuration so that requests for any other virtualhost than example.com or www.example.com would ...


6

you should use both: crawling encouragement using a sitemap.xml – A well structured sitemap.xml can help search engine spiders to find your content quick and directly. And a sitemap.xml gives you the option, of curating what you want to have crawled, how often you consider crawling useful and you can even put a focus on content you find important – the ...


6

To know the age of an URL you can follow this link by replacing www.example.com by the URL you want: https://www.google.com/search?tbs=cdr%3A1%2Ccd_min%3A1%2F1%2F2000&q=site%3Ahttp%3A%2F%2Fwww.example.com&safe=active&gws_rd=ssl For example, here's the result from Google for the Meta site of Stack Overflow: Otherwise, the Wayback machine is ...


5

In general it's best to have ordinary text links to those pages somewhere on the site, if not for SEO then for accessibility reasons. A portion of users will not have Flash or have it disabled through FlashBlock etc. For a site I completed recently we did something similar with a map of the UK. I put links to the cities (only 5 at the moment) underneath the ...


5

There is no official rule as to how long it takes. I've heard anywhere from "instantly" to "a few months later". There are many variables such as how many others are linking to you (and how important they are), and how relevant is your content, and how often does your site get updated. Also, I tend to think some of the spiders kind of "do the rounds" and you ...



Only top voted, non community-wiki answers of a minimum length are eligible