XML Sitemaps are XML files created to make it easier for Search Engine crawlers and other bots to efficiently and fully crawl a website.

learn more… | top users | synonyms

0
votes
1answer
28 views

Should I include both GZ and XML sitemaps in robots.txt?

My sitemap generator has created a sitemap.xml and sitemap.xml.gz file. Should I include just the .gz file in the robots.txt or both? And does it do any harm to submit both sitemaps to Google et al?
0
votes
0answers
14 views

Sitemap.xml of phpbb on aws-s3

I've been looking at options for a sitemap generator for a phpbb website. I found a couple of mods which gave me the solution. But these mods save sitemap xml files on the same instance. I did not ...
0
votes
1answer
16 views

Must the image url in a sitemap file begin with the same domain the file is stored on?

I remember when making a sitemap, all URLs defined in between <loc> and </loc> must be part of the same domain as the domain the file is stored on. For example, I can use this line in my ...
1
vote
0answers
13 views

How to handle multiple images with duplicate titles in an image sitemap?

We got multiple different images for each recipe URL (user-generated content) - therefore, in our image sitemap, there are multiple image URLs with the same title (=recipe title). What are your ...
1
vote
1answer
17 views

Webmaster showing unsupported file as error in sitemap

In my website i have big sitemap. So i compressed t using Gzip. and the format of sitemap is like When i submit this sitemap to webmaster it shows unsupported file.
0
votes
2answers
75 views

Should a Sitemap include the home page?

I have seen some sitemaps that include the home page, eg http://example.com and others that do not. Is including a home page of any use and recommended in any reputable documentation? Edit: The ...
0
votes
2answers
20 views

GWT showing 0 sitemaps links

I currently have 3 sitemaps (as rss) on a large site. Two of them seem to be getting indexed well, but the third (blog-rss.xml) isn't getting indexed at all: Any thoughts on how to diagnose what ...
0
votes
1answer
54 views

Xhtml alternate hreflang, will it ruin my sitemap for Bing/Yahoo and other SE's?

I'm concerned. I recently updated my sitemap generator to create xhtml tags with hreflang in it, to indicate duplicate content pages for different languages. Here's an example: <url> ...
1
vote
1answer
64 views

How to tell crawler my sitemaps in a zip file?

I have 2 big sitemaps (map1.xml, map2.xml) and I have a index file (indexmap.xml) that contains the locations of these 2 files. I zip these 3 files to mymaps.zip. In Google Webmaster Tools, should I ...
1
vote
2answers
32 views

Can sitemaps for multiple sites be added to Google Webmaster Tools through a single universal account?

I had a lot of client websites and recently I had to do SEO for about 3-4 websites simultaneously. It was all simple on page SEO, but I have a question is about XML map submission. I realize that ...
1
vote
2answers
39 views

Duplicate Sitemap URLs

I'm in the process of replacing my old sitemaps with a new form which should better represent our site. However, as bots can take days or even weeks to scan all of our urls after submitted I do not ...
1
vote
0answers
54 views

href lang annotations in xml sitemap file displays issues

Following Google guidelines for creating an sitemap.xml file to add a href lang annotations, I'm getting display issue when viewing the sitemap.xml file in my browser. Instead of looking like a ...
1
vote
2answers
90 views

How do I replace all my XML Sitemaps without hurting SEO?

I am looking for someone to tell me the appropriate procedure to replace all Google sitemaps. I can clearly go in and delete the old ones and simply replace them, but as it can sometimes take many ...
7
votes
2answers
163 views

Is it possible to make an XML sitemap pretty enough to show to users?

I wouldn't mind showing my XML sitemap to users if there were a way to make it human usable as opposed to just machine readable. Is it possible to: Choose the colors and layout Make the locations ...
2
votes
1answer
55 views

Do I need to provide a link to an XML sitemap from pages?

Does an XML sitemap have to be linked to from "normal" site pages? Are there standard sitemap name and location where bots look for it so that I wouldn't need to link to it? Can I just put it in ...
1
vote
1answer
44 views

Should I submit XML sitmaps directly or list them in my robots.txt?

Are there advantages to listing XML sitemap files in robots.txt vs submitting them directly to Google via Webmaster Tools?
0
votes
1answer
37 views

Remove dynamically generated sitemap from google search result [duplicate]

I use Yii PHP framework to generate sitemaps of user profiles. The sitemap url is something like this http://mywebsite.com/site/sitemap33449 This URL returns xml of the sitemap. (with correct ...
3
votes
1answer
97 views

How should I approach sitemap.xml, hreflang and regions for my website

I am a developer on a large site which regionally targets some content with a specific url. Is it technically correct to target the countries in those regions in the sitemap.xml and point them to the ...
1
vote
1answer
35 views

Should a URL shortener service provide XML sitemap entries for shortened URLs?

As a fun project I've written my own URL shortening service. I'd like to know if it makes sense / be useful to include the shortened URLs in the generated XML sitemap. At the moment I'm leaning ...
2
votes
2answers
159 views

When the page language can be determined by the browser settings, which URLs should go into sitemaps?

At this moment our website both uses the language in the url like "en" and localizes the url itself ("books" in english and "boeken" in dutch). Because of the history of making our website ...
1
vote
2answers
134 views

Sitemap.xml generates 404's for URLs with single quotes and commas

I'm going to try and keep this as terse as possible: when it comes to single quotes and commas in the URL, I'm damned if I encode and damned if I don't. If I leave the single quote unencoded in the ...
2
votes
1answer
314 views

Should a responsive site include <mobile:mobile/> in its sitemap?

Should a website built with responsive design include Google's <mobile:mobile/> xml tag in its sitemap.xml? In other words, will marking each of my urls as "mobile" in the sitemap for a ...
0
votes
1answer
161 views

sitemap.xml for a website with forum

We have a website dedicated to our ActiveX and .NET components that has been working for more than 12 years. The site consists of 2 parts: the static part (product descriptions and articles) and the ...
0
votes
0answers
6 views

Google Sitemap Indexing Error [duplicate]

My website has 51 webpages out of which 13 are indexed. i dont know why googlebot are not indexed my complete webpages. please suggest some tips, how to get more and more pages indexed.
2
votes
1answer
43 views

Should Isolated Content appear in Sitemap for SEO purposes?

I have a website with some content that I purposefully want to leave isolated (no incoming internal links) from the rest of the website. I do however want SEO benefits from the content of these pages ...
0
votes
0answers
15 views

Can I save sitemap.xml file in other domain? [duplicate]

I have 2 domain. Domain No.1 contains a sitemap index: http://example1.com/sitemap-index.xml with content like this: <sitemapindex> <sitemap> ...
4
votes
1answer
99 views

Can XML Sitemap include itself as one of the URLs?

A little while ago I discovered an XML sitemap where the sitemap itself was included. <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> ...
0
votes
0answers
8 views

XML sitemap for sites with more than 1m content [duplicate]

i have a website with more than 1m content , i just want know its necessary to create a xml sitemap. and what is best way to index faster in google for big sites like mine?
0
votes
2answers
49 views

Porting some of the contents to new site. Should I delete the old sitemap.xml?

I had a site with multiple blogs for eg www.mysite.com/gre, www.mysite.com/gmat What I have done is that ported the blogs to new site mynessite.com and set up a 301 redirect. The old content becomes ...
3
votes
4answers
493 views

Should I use 'robots.txt' or 'sitemap.xml' to get dynamically created files indexed in search engines?

I've structure my video site like this: / (root) index.html -/videos -/video-id1 (dynamically generated subdirectory when user uploads a video) /index.html (dynamically generated file ...
0
votes
1answer
174 views

Does resubmitting a modified site map affect current ranking?

I have a old sitemap dated 2012 that I submitted in Google Webmaster Tools. I want to resubmit a modified sitemap, but I am worried that my current ranking might suffer. Does anyone have a way that ...
6
votes
2answers
209 views

Google sitemap priorities, am I doing the right thing?

I've built a website which has maritime weather and tide data for UK locations, and each location has 7 day forecast (where data is available). My URL structures are like this: ...
0
votes
2answers
138 views

How should I create sitemap of a site which goes live with thousands of pages?

We are working on an education site and have custom website built on wordpress. One component of site is blog posts and pages, sitemap for which gets built by sitemap plugin every night. Another ...
1
vote
1answer
356 views

What should I do when the maximum sitemap size limit is reached according to Google Webmaster Tools?

We have an existing sitemap with the URL: http://example.com/sitemap/sitemap.xml It was submitted to Google Webmaster Tools a long time ago and almost all the pages were indexed, but recently we ...
0
votes
1answer
221 views

Some website pages not indexed by Google although followed the recommended steps [duplicate]

I have built a website (www.shareall.nl) in wordpress and did some SEO (metadescriptions, headings, links, alt text, microdata, sitemap, robots.txt, etc) using Yoast Wordpress SEO plugin. I did not ...
11
votes
4answers
2k views

Prevent XML sitemaps from showing up in Google search results

How do I prevent my XML sitemap files from showing up in Google search results like this result of a site: search query: I don't understand why Google would choose to show sitemap files in search ...
0
votes
1answer
137 views

Does Google Webmaster Tools allow me to find out which pages are indexed?

If I'd go to Crawl -> Sitemaps section there will be a list of sitemaps with the number of total pages in each one and the number of indexed pages indicated. However I didn't see any way of finding ...
1
vote
1answer
62 views

Where can/should I submit my sitemap.xml?

I know of Google and Bing, but are there other places I can/should submit my sitemap.xml? And do they support pinging?
5
votes
3answers
649 views

Should I include forum posts in the sitemap?

I am launching a medical discussion forum for sharing study materials and discussing other topics. The forum will probably grow fast and reach at least a few hundred topics. Should every discussion ...
2
votes
1answer
81 views

How to spread XML Sitemaps over several webservers behind AWS loadbalancer?

We have a web portal with almost a million products and way more other urls. I wrote a script that checks database. If there is a new url needed or an old one update, this script will update/create ...
0
votes
2answers
815 views

General HTTP error: Domain name not found

I have verified my domain through a TXT record by google, however, my site hasn't indexed yet and I face with sitemap errors in google webmaster tool. I run dns health check from ...
5
votes
7answers
837 views

How to hide my XML Sitemap from competitors but not from search engines

I want to hide my sitemap XML file from all but allow access from search engines. What is the way to do it? I want to hide the depth of site's content from competitors.
1
vote
2answers
72 views

Is it ok to include sitemap URL in sitemap.xml

Does it have sense to include sitemap URL into sitemap? It is pointing to itself and in SEO perspective it's no use because if crawler is on our sitemap he already knows it, no need to inform it, ...
2
votes
2answers
234 views

Should I create a Separate Image XML Sitemap?

My websites currently have a sitemap XML file that use the rel="alternate" to indicate there is an alternate location to my content in another country and language. I am wondering what the best ...
1
vote
1answer
469 views

Sitemap.xml / Update Frequency + Priority 0

I'm working on building sitemaps and am not sure what should and should not be added. For example: https://www.website.com             ...
1
vote
4answers
1k views

What URLs should I put into XML Sitemap?

We will launch a project with over 1.000.000 products and those are in approx 150 categories. Later on you will find reviews and technical detail pages to those products. So there will be more than ...
2
votes
3answers
274 views

How to specify priority content for Google to index first when launching a very large website

My team will go online with a portal that will have over 1.000.000 products. And I read here following text: Prioritize which content you have indexed. With that much data, not all of it is ...
0
votes
3answers
29 views

Sitemap completeness

I have a couple of questions about sitemaps: Does every page need to exists in the sitemap? And what about (ir)relevant parameters on which the content could depend? What about pages which depend ...
1
vote
1answer
3k views

Subdomains as a part of the one site

Let's say that the site consists of some pages like: some_product.example.com some_service.example.com another_product.example.com ...so on Can I work with such a site using Google Webmasters ...
2
votes
1answer
710 views

What is the correct format and attributes for adding a PDF to an XML sitemap?

I have found numerous questions and blogs about including PDF files in an XML sitemap but cannot find a single one that gives a working example or which attributes to use: What document types can be ...