Hot answers tagged sitemap
This post is 4 years old, hope the status in not Pending anymore. But this helped me. After 14 days of pending status, I found this link, to PING bing with your sitemap. It's was a kind of awake call for my sitemap. Few hours later, my site was indexed. Upload yous sitemap (but you already did hence the pending status) Typ in your browser: ...
A sitemap is so that Google can index your pages without having to scrape and investigate every internal link. If you want something indexed, it should be in there. If you don't want it indexed - robots.txt it. It doesn't matter if you use multiple sitemaps or a single large file. There's no limits, advantages, disadvantages outside of management.
Allow: * should actually be be Allow: /. That could be the issue... because, really, using Allow: is somewhat meaningless by itself -- its purpose is for allowing a sub-path within a denied path. As it stands, it seems possible that your file is being misinterpreted. Anything not denied is supposed to be implicitly allowed. If you want to allow ...
In your situation, Don't include "www" because web crawlers that do read the sitemap directive from your robots.txt will attempt to access the "www" version of your sitemap and then be redirected to the non-www version of the URL. Not only will you be wasting a couple extra bytes by including "www", but the crawlers that parse the sitemap directive ...
So long as the entries in the sitemap point to the correct URLs and Google knows to access the sitemap file and is doing so, you're fine. The name of that file is not relevant to the SEO. In other words, my sitemap could be www.mysite.com/f*ckyougoogle.xml and neither the spider nor the algorithm would care.
Only top voted, non community-wiki answers of a minimum length are eligible