New answers tagged google-index
1
Google scans your source code for items that look like URLs and will try to crawl them and index them, even if they are not in an <a href.
Based on the crawling that Googlebot has done on my site, Google seems to think that strings in the page source are URLs if:
They end in a common page extension such as "html", "htm", or "php".
They contain a slash ...
0
If you take a look at your name servers:
http://host.robtex.com/ns2.hostinginmind.com.html#records you can clearly see this is on their network. What's happened at some point in DECEMBER 2012 your site was operating on that domain. Now the problem seems fixed as http://0.3c.7aae.static.theplanet.com no longer works. It may take a couple of weeks for Google ...
1
The URL removal tool prevents your site from appearing in search results, it doesn't "reset" your site's indexing. To allow your site to appear in search again, you need to cancel the removal request.
In general, if those unnecessary URLs now return 404, then they'll drop out on their own, there's no need to submit URL removal requests for them. It can ...
0
Remember, google also index tags, category, and taxonomy. Those also considered as pages by google.
Sometimes , google also index query of your script
e.g.
Example.com/user?id=54
example.com/search?query=query
or maybe, the result is not right,
some time google result is less than it estimates . I once discovered that google said it found 1000++ results, ...
0
The reason can be due to canonical urls. WWW and non-WWW versions can be seen as different pages by Google. That may explain why the numbers doubled. The other reason may be the fact that the pages that you have removed are not yet de-indexed by Google.
To diagnose the issue, I suggest you look through a couple of urls manually.
0
Do I need to "reinclude" the site using the removal tool?
You can't "reinclude" the site using the removal tool?! It is a removal tool. Although it seems you can "undo" (ie. re-include the URLs) by canceling the removal request. However, the docs, suggest that "your content may later reappear in search results" regardless of this action.
You generally ...
0
6500 is the total number of contents/pages or it also keeps track of aggregations, subsections or things like that? if you have, for example, a WP site, you also have to keep in mind that each tag also have at leas one page, so while maybe you do not have content duplicate problems, maybe there are some CMS feature that actually create more pages than you ...
4
First of all, the number of results shown by a site: search is only an estimate.
Try going forward to the next page in the site:mydomain.com search results, and see if the number changes, or if you find something revealing (like some files that shouldn't be there).
If there's really an issue, it could be duplicate content, or some non-HTML content that ...
2
The problem is that you are using noindex on your pages, see line:97 when viewing the source of your page. See below:
Line 96: <meta name="description" content="xxxx" />
Line 97: <meta name="robots" content="noindex,nofollow" />
Line 98: <meta name="googlebot" content="noarchive" />
0
Google searches and indexes multiple languages. There are tons of question on this site about how to organize based on languages (paths, sub-domains, auto-detection, TLDs, etc).
However, it does not search automatically for translated keywords as you suggest. The assumption is that if someone is searching in a language, they will most likely want a page of ...
0
Yes, Google and other search engine spiders will crawl multiple languages. You will want to use unique URLs for each language, however. Usually that's done by including the language code in the URL as a folder or subdomain.
Google also has some advice for providing "alternate" languages of the same page here
0
The problem has resolved itself, after about 1 month. Not sure what the delay was originally, but indexing has returned to normal. Apologies on not updating this thread.
0
Try going to google.com and use the Google Operator "site:mywebsite.ca" to see how many pages are indexed. If nothing is indexed then, either there is a problem with your WordPress installation or the migration, or your site might have been penalised.
To rule out WordPress/Migration try the following:
Check the robots.txt file on the off change that the ...
0
To cover your last point first, if you have 97k URLs indexed but 1.2m URLs found with a parameter, then Googlebot is ignoring many URLs (over 1.1m in fact).
As for the main question, Webmaster Tools states when you set the option "No URL" that they may remove URLs from the index - so there is no guarantee they will be removed.
You should go through those ...
5
That is normal and expected behaviour and in SEO-terms that's called Duplicate Content. So Website A got indexed before Website B, and since the content is identical, Google sees no value in positioning Website B in its search results. There is no way around the issue than to rewrite Website B's content to be unique to get that website positioned in the ...
0
Your website category pages own this following meta tag:
<meta name="robots" content="noindex,follow" />
noindex indicates to Google to not to index your webpage.
To solve the problem, you can delete this meta tag from your category webpages. Your Wordpress SEO plugin (like Wordpress SEO by Yoast) can do it for you.
1
OK, I've finally found a plausible explanation, why Google has indexed folders and files outside of the document root:
The website I've launched last week is a second version of a project. The first version was Joomla! based and its dosument root was to the project root:
/var/www/.../mywebsite.tld
The second version bases on Zend Framework 2 and ...
2
In order to block all robots in your website, the correct code is:
User-agent: *
Disallow: /
Don't forget the / (slash) after Disallow:.
To block only subdirectories and their internal webpages with robots.txt, you have to list them one by one. Thus you need to know their names:
User-agent: *
Disallow: /vendor/
Disallow: /module/
...
To understand how ...
2
This sounds like you want to index search results. If I'm right, it's against Google's guidelines, according to Matt Cutts.
I recommend you to only index valuable content and not auto generated pages.
2
These types of problems are more common than less common in Webmaster Tools sadly, GWT is often out dated or incorrect. GWT does not update as frequently as real time results and you often see these types of problems.
The Google Webmaster Tools Sitemaps Panel looks to be reporting correct as the picture shows that your only viewing that month and I imagine ...
Top 50 recent answers are included
