XML Sitemaps are XML files created to make it easier for Search Engine crawlers and other bots to efficiently and fully crawl a website.

learn more… | top users | synonyms

6
votes
3answers
263 views

Should I include forum posts in the sitemap?

I am launching a medical discussion forum for sharing study materials and discussing other topics. The forum will probably grow fast and reach at least a few hundred topics. Should every discussion ...
1
vote
1answer
23 views

How to spread XML Sitemaps over several webservers behind AWS loadbalancer?

We have a web portal with almost a million products and way more other urls. I wrote a script that checks database. If there is a new url needed or an old one update, this script will update/create ...
0
votes
2answers
36 views

General HTTP error: Domain name not found

I have verified my domain through a TXT record by google, however, my site hasn't indexed yet and I face with sitemap errors in google webmaster tool. I run dns health check from ...
1
vote
3answers
63 views

How to hide a page from visitors but not from search engines

I want to hide my sitemap XML file from all but allow access from search engines. What is the way to do it? I want to hide the depth of site's content from competitors.
1
vote
2answers
29 views

Is it ok to include sitemap URL in sitemap.xml

Does it have sense to include sitemap URL into sitemap? It is pointing to itself and in SEO perspective it's no use because if crawler is on our sitemap he already knows it, no need to inform it, ...
2
votes
2answers
48 views

Should I create a Separate Image XML Sitemap?

My websites currently have a sitemap XML file that use the rel="alternate" to indicate there is an alternate location to my content in another country and language. I am wondering what the best ...
1
vote
1answer
46 views

Sitemap.xml / Update Frequency + Priority 0

I'm working on building sitemaps and am not sure what should and should not be added. For example: https://www.website.com             ...
0
votes
4answers
86 views

What URLs should I put into XML Sitemap?

We will launch a project with over 1.000.000 products and those are in approx 150 categories. Later on you will find reviews and technical detail pages to those products. So there will be more than ...
2
votes
3answers
169 views

How to specify priority content for Google to index first when launching a very large website

My team will go online with a portal that will have over 1.000.000 products. And I read here following text: Prioritize which content you have indexed. With that much data, not all of it is ...
0
votes
3answers
25 views

Sitemap completeness

I have a couple of questions about sitemaps: Does every page need to exists in the sitemap? And what about (ir)relevant parameters on which the content could depend? What about pages which depend ...
1
vote
1answer
15 views

Subdomains as a part of the one site

Let's say that the site consists of some pages like: some_product.example.com some_service.example.com another_product.example.com ...so on Can I work with such a site using Google Webmasters ...
2
votes
1answer
33 views

What is the correct format and attributes for adding a PDF to an XML sitemap?

I have found numerous questions and blogs about including PDF files in an XML sitemap but cannot find a single one that gives a working example or which attributes to use: What document types can be ...
5
votes
1answer
49 views

If I use the same image on multiple pages, should it be on my sitemap multiple times?

Following Google's guide to Image sitemaps <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" ...
2
votes
1answer
20 views

Should I add a site root to the sitemap file?

Is it really necessary to include a root (homedir) of the site to the sitemap? As I can understand the sitemaps main idea - it is not any necessary. Am I right?
0
votes
3answers
63 views

How to make Google index all sitemap.xml records? [duplicate]

I have a sitemap.xml index fine with 3 XML files in it with around 120 pages for indexing. A year passed and I still have 1/3 of it indexed. All the most important pages for indexing are in 1st ...
1
vote
1answer
29 views

Custom Sitemap or sitemap generator tool [closed]

I have recently launched a website which is using a free sitemap generator. It's a large travel agency site with predominantly dynamically generated content - users can add their products as and when ...
1
vote
1answer
45 views

Will there be a conflict between my Sitemap.xml and robots.txt?

I have a robots.txt with the following in it: User-agent: * Disallow: http://tests.compkerworld.com/report_question_error.php?question_id=*&url=* Sitemap: ...
0
votes
2answers
62 views

Google Webmaster Tools can cache sitemap files?

I'm struggling to submit my sitemaps to Google Webmaster Tools. Previously I received report that I have an error in all my sitemaps (the error was at <image:image> tag as I did not specified ...
3
votes
3answers
140 views

Generate a sitemap automatically, does it need to be XML?

I want to create an XML sitemap (for the sake of SEO), my first attempt to achieve this was by including the website main menu/navigation links using <?php include ("assets/includes/menu.inc"); ...
0
votes
1answer
32 views

How many XML sitemap can generate for one site and is it hammer to SEO ranking?

How many XML sitemap can generate for one site and is it hammer to SEO ranking?
1
vote
1answer
24 views

Track the modification time of files with a regeneratable website

I have a website that is automatically regenerated every day based on a fresh copy of an externally-supplied database, which has no concept of the modification time of the individual records (e.g., ...
1
vote
1answer
60 views

New sitemap isn't being crawled, but the old sitemap is

I am helping on a website, it was redone a few months ago. We have 301 redirection links set, uploaded a new sitemap (with the updated links) and submitted it. But only one page is getting indexed ...
0
votes
0answers
31 views

How to overcome duplicate content SEO impact when enforcing https (SSL) site wide on an existing site [duplicate]

We're about to move a large existing site to https (SSL). I was a little concerned after reading this thread. Has anyone else experienced a negative impact when transitioning from http to https? ...
0
votes
1answer
48 views

Sitemap.xml doesn't seem to be working properly [duplicate]

I have a sitemap.xml on one of my domains. It contains the following: <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> <url> <loc>http://www.domain.com</loc> ...
0
votes
0answers
10 views

Do I need to produce an xml sitemap for a social network? [duplicate]

I'm working on a social network that currently does not have an xml sitemap that has been submitted to Google Webmaster Tools. Will this add much benefit given that it is a social network with often ...
0
votes
1answer
45 views

Splitting a sitemap by content type

I currently am tasked with submitting our website sitemap to the search engines every week. We have a module which does offer sitemap generation but we find using it does not work very well as not ...
0
votes
0answers
23 views

Most of my pages weren't indexed [duplicate]

I've submitted a sitemap (XML) of my Drupal (7) site to Google Webmaster Tools and it says that my sitemap contains 285 pages and that only 87 pages were indexed. There are no errors and no ...
0
votes
0answers
8 views

Google not showing the sitemap after submitting it [duplicate]

I am trying to submit the sitemap to the Google. I have already submitted the sitemap - xml path to Google 2-3 times. but when I put my website URL on Google search, it not showing the menus or it ...
1
vote
2answers
25 views

Should expired or deleted eShop links be removed from an XML sitemap?

If I delete a product should I remove its link from the sitemap.xml also? Is there any penalty from Google for leaving a lot of dead links in my sitemap? What is the most common practice and why? It ...
2
votes
2answers
192 views

Indexed URLs in Google Webmaster Tools are missing after migrating to another framework

I migrated my site last week from an old .aspx framework to a new site hosted via WordPress. The domain name is the same and I am seeing no errors when I test and submit the sitemap via Google ...
0
votes
0answers
10 views

SEO and Mobile XML sitemap [duplicate]

On my sites, I used the scheme that Google defines: "Dynamically serving different HTML on the same URL" when I offer a mobile version of my code. I have only one URL for each page. By checking the ...
0
votes
1answer
59 views

Does PageRank flow to pages that are only listed in the sitemap.xml?

Let's say you have a small website that has a PR of 3. On top of that you have on the domain itself a blog that is not linked to the website. The blog along with its posts are however listed in the ...
2
votes
2answers
81 views

Do all pages have to be added to XML Sitemaps?

I'm planning to add an XML Sitemap to a client's existing website. According to this, it will help define the difference between the root website (aimed at UK) and the US website (aimed at the United ...
1
vote
1answer
335 views

Problem with Google Webmaster Tools Sitemap

I have a WPMU 3.6.1 with Domain Mapping (0.5.4.3) with W3TC (0.9.3) and Google XML Sitemaps (4.0 BETA). I have 4 different sitemaps. sub-1.com/sitemap.xml sub-2.com/sitemap.xml ...
1
vote
1answer
97 views

change sitemap after 301 redirect

when i use of 301 redirect for all URLs ... should i change sitemap URLs ??? ...... if Sitemap contains following URLs example.com/cat/1.html example.com/cat/2.html example.com/cat/3.html should i ...
2
votes
1answer
94 views

How is it possible that Google has indexed more URLs than a sitemap contains? [duplicate]

Google has processed my XML sitemaps, and for one of the files, Webmaster Tools claims to have indexed 44,797 links even though that file only contains 4,582 links. Here's a screen cap: I'm not ...
0
votes
1answer
112 views

Sitemaps: rel=“alternate” hreflang=“x” naming

I'm creating a Sitemap for rel="alternate" hreflang="x", but no where in Google's guidelines do they mention how it should be named. Also can we reference it separately in the robots.txt file, or does ...
1
vote
1answer
135 views

Making my domain show up instead of my sitemap.xml in Google search results

If I search Google for a term or my site name, Google returns the URL sitename.com/sitemap.xml on the first or second page of the results. I want the main site to return in the results and not the ...
0
votes
0answers
84 views

404 errors still showing in Webmaster Tools

I've a website with Yola, I've been blogging twice a day for three to four years now and suddenly about a month ago, every blog post URL was being seen by Google as a 404 error. I started off by ...
1
vote
2answers
2k views

Sitemap submission : Do sitemaps need to be resubmitted when they are updated?

In short: Should I resubmit my sitemap through Google Webmasters Tools every time I replace a sitemap.xml with an existing sitemap.xml (i.e., www.domain.com/sitemap.xml)? Or does it check it ...
2
votes
1answer
230 views

How to auto generate my website sitemap regurlarly (day)?

I have developed website in Zend framework, it's like a blog. I'm worried about posting URL links, as they are not being indexed in Google. However, if I generate sitemap.xml externally, and upload ...
1
vote
1answer
60 views

Why is this date in my sitemap “invalid” according to Google

My XML sitemap file has <lastmod>2013-07-06T09:39:51-0400</lastmod> formatted with W3C Datetime Format. Google has a warning message in webmaster tools about this for me: Google's ...
1
vote
2answers
578 views

sitemap.xml file extension, does it have to be .xml?

Do XML sitemap files have to end with the .xml file extension? On the Bigcommerce platform, their XML sitemap file are defined as: http://www.examplesite.com/xmlsitemap.php The sitemap file is ...
2
votes
4answers
847 views

Do you really need robots.txt and sitemap.xml if I want bot to follow every link? [duplicate]

I wonder if I really need robots.txt/*sitemap.xml* files if I want bots to go through every link on my website without any restrictions? And if I do, what should I write in there?
3
votes
1answer
447 views

Why does my sitemap have a “.gz” extension, and how can I edit it?

An XML sitemap generator plugin for WordPress puts the following strings in my robots.txt file: User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ But other WordPress blogs have lots of ...
4
votes
1answer
74 views

Understanding product search links in sitemaps

I am looking at sitemaps of a few large websites like ebay.com and I noticed that the URLs in the sitemap point to search results rather than the actual product page and I have confirmed that all the ...
1
vote
1answer
258 views

Why important/big sites don't include a sitemap? [closed]

I've been looking at most important sites and none of them have a sitemap.xml defined. My list includes: Amazon Ebay Yahoo Microsoft ... and others But none of them include a sitemap.xml file. Why ...
0
votes
1answer
156 views

Should I add the CDN or the source URL of an image to the XML image sitemap?

I'm creating a WP plugin and I have the source URL for the image and the CDN URL to the image as well that is generated by replacing the host to the CDN host. Which is better, if I add the source URL ...
3
votes
4answers
252 views

How does Google have more results than I have pages?

Our site has about 6500 pages. These are kept up to date in our sitemap.xml. When I go to our Google Webmaster Tools account I see that Google has indexed about 6000 of our pages. This seems quite ...
4
votes
2answers
630 views

Can a sitemap index file reference sitemap files under different domains?

My company owns several domain names. We also host websites for our users at their custom domains. Our domains: company.com product1.com product2.com Users's domains: user1.com user2.com ...