36

There are a number of reasons your content may not appear in search engine results, however, it is important to note that a search engine's index may contain pages that it doesn't display in its results page. How to tell if your content is actually indexed It may actually be difficult to tell if your content is indexed. Search for all the documents from ...


22

Your website has been compromised and it is being used by blackhat SEOs. This is a pretty common thing amongst spammers and the like. Take a look at: My site's been hacked - now what?, by Google. Download a backup of your website. Make sure that you also backup the database, not just the files. Get in contact with your web host and explain the situation. ...


18

No, it will not affect the final letter case format of your domain whatever letter case you choose while registering it. The Domain Name System (DNS) names is case insensitive and you can not manipulate this by any mean when you register it or even define it to search engines for "good looking" purposes. All cases (upper and lower) will be accepted when ...


17

Google's Matt Cutts has addressed this via video: It’s a fair question. I think we can handle it either way, so we should be able to process it. But if we see a lot of pages or a lot of things ranking on a site all of a sudden, then we might take a look at it from the manual webspam team. So if it doesn’t make any difference whatsoever to you in terms of ...


14

In the root of the directory of the subdomain website, add a file called robots.txt containing: User-agent: * Disallow: / This will tell web crawlers not to index the site at all. They do not have to obey, but the main ones will.


12

Here is the same answer I provided to noindex tag for google on Stack Overflow: You can prevent Google from seeing portions of the page by putting those portions in iframes that are blocked by robots.txt. robots.txt Disallow: /iframes/ index.html This text is crawlable, but now you'll see text that search engines can't see: <iframe src="/iframes/...


12

In the Disallow field you specify the beginning of URL paths of URLs that should be blocked. So if you have Disallow: /, it blocks everything, as every URL path starts with /. If you have Disallow: /a, it blocks all URLs whose paths begin with /a. That could be /a.html, /a/b/c/hello, or /about. In the same sense, if you have Disallow: /search, it blocks ...


11

Yes, the latter one is better. Yet, if applicable, /john-smith is better than /johnsmith


11

You should use separate meta tags for each page of your site and the content of these tags should reflect the page content rather than the site theme. For the record you are only going to get so far with Meta tags. By far the most important thing to consider is the text within your title tag. The Meta description tag can be useful and will be used by ...


11

Great question, and one many webmasters might be interested in since the Baidu spider is notoriously aggressive and can zap resources from servers... As indicated in Baidu's Web Search news, the Baidu spider does not support the Crawl-delay notification setting, and instead requires you to register and verify your site with its Baidu Webmaster Tools ...


10

You really only need the disallow. Search engine crawlers will automatically assume they are allowed everywhere that isn't disallowed. User-agent: * Disallow: /templates_c But to answer your question, according to Google: At a group-member level, in particular for allow and disallow directives, the most specific rule based on the length of the [path] ...


10

Search engines have no way of knowing what traffic your website gets so it can't be used as a ranking metric in their algorithm. (Google has clearly stated that Google Analytics data is not used in their ranking algorithm). Even if they did, the number of visits would not be a good judge of relevance as it is easy to artificially inflate your number of ...


9

Update: As of Jan 30, 2015, Googlebot supports TLS 1.2 . See Post by Google: Googlebot now supports TLS version 1.2, in addition to previous versions: TLS 1.0, TLS 1.1 and SSLv3. As of September 14th, 2014, the Googlebot does NOT support TLS 1.2. You get notified about 100% inaccessibility and thats it. I am affected by this directly. Using TLS 1.2 ...


8

Most of the comments on this are actually from 2013 so I thought I'd provide an updated perspective. I just did an experiment on this. Here's what I found: Published blog post date (and not necessarily index date) definitely affect SEO If the published date is very recent, you may see a significant increase in traffic (I saw 45% boost sitewide - some pages ...


8

Whilst DNS itself is case-insensitive, at least one search engine allows you to declare preferred case in search results: Yandex. The Case of the site name tool lets you set preferred capitalisation in certain cases. This can be accessed in Yandex.Webmaster under Appearance in search results > URL letter case. I've set this for a few of my sites and it's ...


7

Stack Overflow and other Stack Exchange websites are favored by Google and other search engines because of the following: great content architecture and structure, a lot of original content, many quality inbound/outbound links, appropriate on-page keywords/tags, an internal rating system, dedicated community moderation, new content all the time. Due to ...


7

Google has a specific guideline against creating filler pages. They call it "doorway pages". Doorway pages are typically large sets of poor-quality pages where each page is optimized for a specific keyword or phrase. In many cases, doorway pages are written to rank for a particular phrase and then funnel users to a single destination. Whether deployed ...


7

I am taking this as your question- repeated phrases or different phrases with the same meaning. I am going to take a side-trip, but bare with me- I am sure we will arrive at the right place. The reason is, I am not sure you understand the basics of SEO well enough. So please humor me. It will make sense in the end. When you talk about SEO, you really are ...


6

Using a robots.txt file in your subdomain will help (and Google will obey this), but another step you can take is to specify with a Google Webmasters account that you don't want this subdomain to be indexed. You can also use a meta tag on all pages in the subdomain: <meta name="robots" content="noindex"> If this happens to be a site that you are ...


6

First of all, as you're mentioned the reason to change that are cookies - there's no need - see "sub-domain cookies, sent in a parent domain request" on Stackoverflow: The leading dot in the domain value .example.com means example.com and its sub-domains. Without the leading dot, the cookie is only valid for this specific domain. Note that when ...


6

For years, I haven't seen a site ranking in Google that doesn't have a domain name. That doesn't mean it isn't possible, but few (if any) sites are doing that now. Here are a bunch of reasons that you should get a domain name: IP addresses cannot be moved from one web host to another the way that domain names can. IP Addresses change. It is very ...


6

Some search engines and bots send HEAD request to pages before sending the GET request for reasons like: Checking if the page size has changed Checking the last modified date etc. (Any other info the head would give them!) This would help large crawlers save a lot of bandwidth if they know a page has not been changed meanwhile and they don't have to crawl ...


6

In SEO perspective wrapping contents with <div> tags is not an issue but large amount unwanted coding will increase the bytes of data which may increase the PageSpeed. Here an extract from this source: Compacting HTML code, including any inline JavaScript and CSS contained in it, can save many bytes of data and speed up downloading, parsing, and ...


6

Both of those would work, but they would also block anything else in those directories. If you only want to block that specific URL, you could do: Disallow: */blah/assets/ico/favicon.png Do you have a Google Webmasters Account setup? If so they have a new robots.txt test page where you can see if a URL is blocked or not based on your robots file. EDIT: ...


6

You can block Google and other search engines by using a robots.txt file and meta name no index. You can use one or the other but Google recommends that you use both robots and meta. To block a specific bot you use something like this within the robots.txt file: User-agent: bot-name Disallow: / To block a specific bot using HTML then include this meta ...


6

This is a really good question! However, the answer can be found relatively easily with a site:stackoverflow.com "A language-independent collaboratively" search. The first thing you need to know: https://support.google.com/webmasters/answer/35624?rd=1 We use a number of different sources for this information, including descriptive information in the ...


5

check this thread in Google forums, AJAX Crawling working with hash but not meta tag. There is an issue with google Fetch tool.


5

I am not sure what your goal is but it sounds like you want to game the search engines and I think that is a waste of time. Sure it might work for a while but Google made 500+ algorithm updates in 2011. If you have something that actually offers value to people then make it available/visible. Tell people about it, make it easy for them to bookmark and share,...


5

There's no other choice than to get your name out there! You need inbound links to your site, try to reach out to bloggers to talk about your site, start your own blog and talk and link to it. Get on social medias: Facebook Pages, Google+, Twitter, LinkedIn, etc. Remember to fill out information about your web site. Search for your keywords and check the ...


5

Make sure to put emphasis on perfecting your <title>, <meta>, and <h1> tags. Thats about all you can do on-site. You might also want to look into Dublin Core and Open Graph tags to give search engine's some more context. If you want more gritty details, there are sites available that will generate complete reports for you (WooRank comes to ...


Only top voted, non community-wiki answers of a minimum length are eligible