There are a number of reasons your content may not appear in search
engine results, however, it is important to note that
a search engine's
index may contain pages that it doesn't display in its
How to tell if your content is actually indexed
It may actually be difficult to tell if your content is indexed.
Search for all the documents from ...
Your website has been compromised and it is being used by blackhat SEOs. This is a pretty common thing amongst spammers and the like. Take a look at: My site's been hacked - now what?, by Google.
Download a backup of your website. Make sure that you also backup the database, not just the files.
Get in contact with your web host and explain the situation.
No, it will not affect the final letter case format of your domain whatever letter case you choose while registering it.
The Domain Name System (DNS) names is case insensitive and you can not manipulate this by any mean when you register it or even define it to search engines for "good looking" purposes.
All cases (upper and lower) will be accepted when ...
Google's Matt Cutts has addressed this via video:
It’s a fair question. I think we can handle it either way, so we should be able to process it. But if we see a lot of pages or a lot of things ranking on a site all of a sudden, then we might take a look at it from the manual webspam team. So if it doesn’t make any difference whatsoever to you in terms of ...
Here is the same answer I provided to noindex tag for google on Stack Overflow:
You can prevent Google from seeing portions of the page by putting those portions in iframes that are blocked by robots.txt.
This text is crawlable, but the following is
text that search engines can't see:
In the root of the directory of the subdomain website, add a file called robots.txt containing:
This will tell web crawlers not to index the site at all. They do not have to obey, but the main ones will.
In the Disallow field you specify the beginning of URL paths of URLs that should be blocked.
So if you have Disallow: /, it blocks everything, as every URL path starts with /.
If you have Disallow: /a, it blocks all URLs whose paths begin with /a. That could be /a.html, /a/b/c/hello, or /about.
In the same sense, if you have Disallow: /search, it blocks ...
Great question, and one many webmasters might be interested in since the Baidu spider is notoriously aggressive and can zap resources from servers...
As indicated in Baidu's Web Search news, the Baidu spider does not support the Crawl-delay notification setting, and instead requires you to register and verify your site with its Baidu Webmaster Tools ...
You really only need the disallow. Search engine crawlers will automatically assume they are allowed everywhere that isn't disallowed.
But to answer your question, according to Google:
At a group-member level, in particular for allow and disallow
directives, the most specific rule based on the length of the [path]
Search engines have no way of knowing what traffic your website gets so it can't be used as a ranking metric in their algorithm. (Google has clearly stated that Google Analytics data is not used in their ranking algorithm).
Even if they did, the number of visits would not be a good judge of relevance as it is easy to artificially inflate your number of ...
Update: As of Jan 30, 2015, Googlebot supports TLS 1.2 . See Post by Google:
Googlebot now supports TLS version 1.2, in addition to previous
versions: TLS 1.0, TLS 1.1 and SSLv3.
As of September 14th, 2014, the Googlebot does NOT support TLS 1.2. You get notified about 100% inaccessibility and thats it. I am affected by this directly. Using TLS 1.2 ...
Most of the comments on this are actually from 2013 so I thought I'd provide an updated perspective.
I just did an experiment on this. Here's what I found:
Published blog post date (and not necessarily index date) definitely affect SEO
If the published date is very recent, you may see a significant increase in traffic (I saw 45% boost sitewide - some pages ...
Whilst DNS itself is case-insensitive, at least one search engine allows you to declare preferred case in search results: Yandex.
The Case of the site name tool lets you set preferred capitalisation in certain cases. This can be accessed in Yandex.Webmaster under Appearance in search results > URL letter case.
I've set this for a few of my sites and it's ...
Google has a specific guideline against creating filler pages. They call it "doorway pages".
Doorway pages are typically large sets of poor-quality pages where each page is optimized for a specific keyword or phrase. In many cases, doorway pages are written to rank for a particular phrase and then funnel users to a single destination. Whether deployed ...
I am taking this as your question- repeated phrases or different phrases with the same meaning.
I am going to take a side-trip, but bare with me- I am sure we will arrive at the right place. The reason is, I am not sure you understand the basics of SEO well enough. So please humor me. It will make sense in the end.
When you talk about SEO, you really are ...
Using a robots.txt file in your subdomain will help (and Google will obey this), but another step you can take is to specify with a Google Webmasters account that you don't want this subdomain to be indexed. You can also use a meta tag on all pages in the subdomain:
<meta name="robots" content="noindex">
If this happens to be a site that you are ...
First of all, as you're mentioned the reason to change that are cookies - there's no need - see "sub-domain cookies, sent in a parent domain request" on Stackoverflow:
The leading dot in the domain value .example.com means example.com and its sub-domains. Without the leading dot, the cookie is only valid for this specific domain.
Note that when ...
For years, I haven't seen a site ranking in Google that doesn't have a domain name. That doesn't mean it isn't possible, but few (if any) sites are doing that now. Here are a bunch of reasons that you should get a domain name:
IP addresses cannot be moved from one web host to another the way that domain names can.
IP Addresses change. It is very ...
Some search engines and bots send HEAD request to pages before sending the GET request for reasons like:
Checking if the page size has changed
Checking the last modified date
etc. (Any other info the head would give them!)
This would help large crawlers save a lot of bandwidth if they know a page has not been changed meanwhile and they don't have to crawl ...
In SEO perspective wrapping contents with <div> tags is not an issue but large amount unwanted coding will increase the bytes of data which may increase the PageSpeed. Here an extract from this source:
contained in it, can save many bytes of data and speed up downloading,
parsing, and ...
Both of those would work, but they would also block anything else in those directories. If you only want to block that specific URL, you could do:
Do you have a Google Webmasters Account setup? If so they have a new robots.txt test page where you can see if a URL is blocked or not based on your robots file.
You can block Google and other search engines by using a robots.txt file and meta name no index. You can use one or the other but Google recommends that you use both robots and meta.
To block a specific bot you use something like this within the robots.txt file:
To block a specific bot using HTML then include this meta ...
This is a really good question! However, the answer can be found relatively easily with a site:stackoverflow.com "A language-independent collaboratively" search.
The first thing you need to know:
We use a number of different sources for this information, including
descriptive information in the ...
According to Google
If Google understands the content on your pages, we can create rich snippets—detailed information intended to help users with specific queries. For example, the snippet for a restaurant might show the average review and price range; the snippet for a recipe page might show the total preparation time, a photo, and the recipe’s review ...
With respect to the above answer, the OP did say he wants to protect "most" of his content. This gives us enough to build an SEO-friendly paywall.
If someone asked me to set up such a system, here is what I would do:
I would allow the first 250 or so words of any article to be publicly visible. I would then make this the "preview/summary" field in the CMS. ...
Bing will follow the redirect no problem so there's nothing you should alter if its a 301 redirect. Your find with Bing it takes many weeks and months to get into their indexed compared to Google. Also bing is much more fussy on indexing pages so ensure the page is uniqne and offers good content.
Watching Bing Indexing is Like Watching Paint Dry
I have ...
Essentially this message means that we (Google) discovered a surprisingly large number of unique URLs while crawling previously-known URLs. This message is sent out before we attempt to crawl those new, unique URLs (since that can take quite some time), it can be useful to inform you of issues with regards to crawlability of your website's structure. Because ...
After a lot of research and experimentation with this, I finally bit the bullet and set up a Baidu Webmaster Tools account. Its quite straightforward to use when armed with Google Translate in another window. You may need to have firebug activated in order to be able to copy-and-paste Chinese text from buttons that you cannot capture from the normal browser ...