Tag Info

Hot answers tagged

35

This is not uncommon as there is no time frame for Google to index a website. The best thing you can do is to give Google every opportunity to find you. Try all of the following: To submit your site to Google go here. Submit an XML sitemap. You can do that from within your Webmaster Control panel. Here's a drupal add on to make this easy for you. Get ...


13

I would strongly recommend registering your site with webmaster tools. There is a crawler access section under site configuration that will tell you when your robots.txt was last downloaded. The tool also provides a lot of detail as to how the crawlers are seeing your site, what is blocked or not working, and where you are appearing in queries on Google. ...


13

There are 2 main ways to prevent search engines from indexing specific pages: A Robots.txt file for your domain. The Meta Robots tag on each page. Robots.txt should be your first stop for URL patterns that match several files. You can see the syntax here and more detailed here. The robots.txt file must be placed in the root folder of your domain, i.e. at ...


9

The main reason for your pages not being indexed is because there are no html links. You're providing javascript links to the other pages and while the #! denotes that it should be a different page - you're not upholding your end of Google's javascript crawling agreement: An agreement between crawler and server In order to make your AJAX application ...


8

I researched the answer to this question this way: using Google since this is the example I have, how Google gets creation dates and modified dates, and date formats that Google recognizes. Please understand that this information does not exist on just a few pages and I had to ferret out the data from very many sources some of which do not seem to apply ...


7

First, I hope you put a proper 301 redirect for any page in your htaccess. If some of your pages require parameters, like example.com/?p=20, then you need to use mod_rewrite with [R=301] instead of the easier mod_alias Redirect directive in your htaccess. Also, until Google Bot comes again and indexes, it will not update the Google index. Second, it will ...


7

Check out the URL removal tool in Google Webmaster Tools. I'd also 404 the pages instead of redirecting them to get them removed faster, in the future beyond robots.txt you could drop in the rel="canonical" to make sure Google knows the dev site is just a copy of the main site and is not to be indexed.


6

Google periodically scan web. Might be your site is not scanned till now. Checklist You have proper robots.txt Some of posts at your site are linking to other posts of your site. sitemap.xml is placed on proper path. And its entry is mentioned in robots.txt. You had successfully submitted your site sitemap to google and other web search engines. I'll ...


6

Wordpress is set to ping Google whenever you write a new post. From http://wordpress.org/support/topic/google-blog-pinging Settings->Writing. At the bottom you'll find a list of "Update Services". The default is to ping the pingomatic server, which then pings a dozen or more other places for you, Google included. However, if you want to ping Google ...


5

It is best to let them disappear as long as your redirects are 301's. Google will in time see that they are 301(permanent) redirects and will switch over to the new URL. I have done this myself and you should see results within 2-4 weeks, if not faster. If it has been more than a month and your old URLs are still showing up in Google's SERPs then you ...


5

There are various theories as to how Google knows what to crawl. It could be that someone linked to your mobile version. It could be that Google tried random urls and came across the /m version of your site. I'm not aware that they say they won't use URLs from their analytics data. Yes they do follow those rules: ...


5

Do you have any other sites pointing to it? Ironically the fact you've added a link to it from this site will ensure it does get indexed (not 100% but I would put money on) Any way, it is indexed: Google Link Also, your code is poor... You have this code (as an example - this is copied from your site): <img src="/images/arrow_to_login2.png" ...


5

The reason google is not following your Shebang (#!) links is because when the page loads initially they do not exist and they are no where to be found in the source code. In other words with javascript disabled you do not have a single <a> anchor tag in your html source of your page. The only thing that will be indexed is a blank page with copyright. ...


5

The home page of your site is indexed and cached by Google and appears in search results. See this screenshot of a search including a string of text taken from your page: Remember that a "site:" search in Google doesn't necessarily show all the pages that have been indexed, and that the order of pages doesn't reflect the "value" of each page.


5

That is normal and expected behaviour and in SEO-terms that's called Duplicate Content. So Website A got indexed before Website B, and since the content is identical, Google sees no value in positioning Website B in its search results. There is no way around the issue than to rewrite Website B's content to be unique to get that website positioned in the ...


5

Will google still crawl to Full_Res_Image and index that in web as well as google images? Yes. If it does crawl to the full res image, how do I then set alt tags on the full res image? You can't but you can still use other indicators of content such as: Use the alt attribute on the cropped image. By being the effective anchor text of that link ...


4

There shouldn't be any noticeable SEO difference between your own domain and a wordpress.com sub-domain in Google. Google ranks pages, not domains. Unless your domain is considered spam, it is a better option to host your blog/site in your domain. In your own domain, you can install plugins to improve SEO by creating a XML sitemap. You can also choose a SEO ...


4

Simple answer: they don't deserve to be there. They could be thin-content, duplicate content, poor content or any other such reason. It's Google's prerogative to decide what should, and what shouldn't be included in it's index. The purpose of an XML sitemap is to allow Google to discover pages that would be suitable for inclusion in it's index, but for one ...


4

First, the Google Webmaster Tools will tell you how many pages are in the index. Google may have dropped pages from its index from multiple reasons, which they will NOT tell you, but the most probable is duplication or very similar content. If you feel that Google is not indexing enough content then you should check the webmaster tools under ...


4

Would generating sitemap xml improve indexing? In theory, but there are no promises, either. ("Google doesn't guarantee that we'll crawl or index all of your URLs." etc.) Sitemaps can be helpful for bots to find all your pages, but they're informational; they aren't required to do anything with them. The search engines may decide to disregard some ...


4

There is no timetable for when Google will crawl and/or index your pages. For new sites it usually is a not very quick process unless you happen to get a high quality link or two pointing to your pages. That always speeds things along but rarely happens. The best thing you can do to speed up the process is to promote your site and seek realted/quality links ...


4

As I see it, you basically have two problems: Google keeps returning the mistakenly created duplicate URLs in search results, confusing users, and Googlebot keeps trying to recrawl the duplicate URLs, slowing down the crawling of your actual pages. The first problem is more serious, since you're actually losing visitors. The best way to solve it would ...


4

You have an old and outdated architecture, so it's pretty hard to make any actionable recommendation. What I would do : Remove the external sitemap file on hostedsitmaps.com, an external sitemap is not a sign of quality. Host it on your site. Redirect with 301 example.com to www.example, or the other way. Choice www.example or .example then stick with it. ...


4

This might help: http://support.google.com/webmasters/bin/answer.py?hl=en&answer=35624 It appears that it is a Google behaviour. The title tag may not be descriptive enough - maybe there are lots of other pages on the site with similar titles...? EDIT: Specifically (quoting from the above page): If we’ve detected that a particular result has one ...


4

First of all, the number of results shown by a site: search is only an estimate. Try going forward to the next page in the site:mydomain.com search results, and see if the number changes, or if you find something revealing (like some files that shouldn't be there). If there's really an issue, it could be duplicate content, or some non-HTML content that ...


3

The 'site:' indiciator is not a reliable operator. Google won't de-index your data, but probably just choose not to show it in the SERPs (for a number of reasons that can't be determined due to the vagueness of the question) - though as I mentioned in my comment, with such a large site of 'unique' content the quality may be fairly low.


3

According to Google: In general, we don't follow them. This means that Google does not transfer PageRank or anchor text across these links. Essentially, using nofollow causes us to drop the target links from our overall graph of the web. However, the target pages may still appear in our index if other sites link to them without using nofollow, or ...


3

"5 URLs in web index" means that, of all of the pages in your current sitemap, only five of them appear in Google's index. This could be for a number of reasons: You only have 5 URLs in your current sitemap. (If this is the case, '5 URLs in web index' is exactly what Webmaster Tools should be reporting.) Some pages appear in your sitemap that Google hasn't ...


3

You need to use a canonical meta. I've explained it in this answer. You question is not exactly a duplicate but the answer is the same. Put a meta canonical in your file indicating the right name of search engines to use. As in: <link rel="canonical" href="http://www.site.com/path-you-want" />



Only top voted, non community-wiki answers of a minimum length are eligible