A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

171
votes
19answers
25k views

The Sitemap Paradox

We use a sitemap on Stack Overflow, but I have mixed feelings about it. Web crawlers usually discover pages from links within the site and from other sites. Sitemaps supplement this data to allow ...
58
votes
4answers
29k views

Are there any clear indicators that my sitemap file is beneficial?

I have recently created a sitemap.xml file and uploaded it to my Google Webmasters Tools account. Google didn't report any issues or errors with the uploaded sitemap of my site. Now my question is: ...
17
votes
6answers
4k views

Why did Google stop indexing pages from our sitemap.xml?

We're seeing some pages that exist in our sitemap.xml but are inexplicably missing from Google's public search index. You can't download http://superuser.com/sitemap.xml -- we protect this file ...
13
votes
4answers
365 views

easy tool for creating XML sitemaps? (constantly expanding site)

Does anyone recommend either a php script that I can run as a CRON or somekind of thirdparty tool i can use to create sitemaps? My website is events bases and so the pages are pretty ...
13
votes
1answer
1k views

Should I include everything in the sitemap or only new content?

For a website with dynamic content (new content is constantly being added), should I only include the newest content in the sitemap or should I include everything (with a sitemap index)? What are the ...
11
votes
6answers
986 views

Is it necessary/useful to build a sitemap for a small website?

I've created several small scale websites, usually for small businesses. They usually contain some information about the company, a contact form, and sometimes a few dynamic parts : news, pictures, ...
11
votes
1answer
411 views

Proper sitemap.xml setup

I have a dynamic site which has many (well, less than 50) users. Each user is allowed to create as many pages as they want. I know that there is a limit to how many pages you can be listed in ...
11
votes
3answers
2k views

How to create a good sitemap for dynamic website

I have a website with dynamic content and different kind of pages. I have some pages that rarely change, and I have pages like blogs that change often. The blog pages also have links for sorting, for ...
10
votes
5answers
3k views

& in sitemap links, are they correct?

Simple question, I'm asking just to make sure. A Google sitemap generator generated a sitemap.txt fle with links written like this: http://www.domain.com/category.htm?name=some-name&cat_id=8 ...
10
votes
2answers
751 views

Google is changing my urls in search results - Joomla3 bug

My urls is something like escene.ir/component/products/تلفن-های-تحت-شبکه-مدیریتی/Escene-ES620-PEN-IP-Phone?task=view.12 but when I try to search site:escene.ir to see the whole links of my site, ...
10
votes
2answers
2k views

How to properly use Google Webmaster Tools (for “non-www” instead of “www”)

I'm trying to use Google Webmaster Tools correctly: I don't use the www in my website's URL, but just noticed that I must have entered the www when I originally added my site to Webmaster Tools a few ...
10
votes
1answer
298 views

using multiple sitemaps in a domain

I have a domain http://sub.example.com/. In it there is a wordpress blog at http://sub.example.com/blog and other more static content at http://sub.example.com/other, http://sub.example.com/stuff, ...
8
votes
2answers
376 views

Dynamic sitemap file

Does it matter if I serve sitemap.xml as a dynamic page? e.g., use .htaccess to rewrite sitemap.xml (or whatever static URL I submitted at the Webmaster Tools) to a PHP file. The PHP file will call ...
8
votes
2answers
2k views

Ask.com sitemap crawler down (for good)?

I have been using Ask.com as one of the search engines to ping my sitemap. When I went to ping my sitemap today to have my sitemap re-indexed, the website (http://submissions.ask.com/ping) says it no ...
8
votes
2answers
564 views

Have search engines recognise multi-lingual sites

I have organised my site by language using the following structure: www.domain.com #spanish language version homepage www.domain.com/en #english language version homepage The site is of Spanish ...
8
votes
1answer
5k views

Does sitemap.xml have to be in the root directory?

This may be a simple and absurd question, but is it completely necessary for sitemap.xml file to be in the root directory of the wordpress install directory of the site, or is it ok to create a ...
7
votes
5answers
1k views

Is it possible to 'trigger' indexing on a site?

We're launching a redeveloped site soon. Google has already indexed the site that we're going to replace, but the links that google indexed are no longer applicable, because the new site has a totally ...
7
votes
2answers
142 views

Can a sitemap change result in a drop of visits?

I recently restructured and resubmitted the sitemap for a website of mine in GWT. The old one was built by a script I acquired, which had its flaws but dit the job. After having implemented URL ...
7
votes
4answers
179 views

Sitemaps HTML and others

I am looking for the best resources on how to build sitemaps. I am currently aware of the obvious HTML sitemaps and the (google) sitemap.xml and (yahoo) urllist.txt Anyone know of resources for ...
7
votes
1answer
142 views

Should the urls in the sitemap contain the slug?

I'm coding the sitemap logic of my side-project blogging platform and I would like to know if omitting the slug in the <loc> nodes of the sitemap could be a problem for the crawlers. Having two ...
7
votes
6answers
226 views

In regards to SEO, is a site map important for a small 3 page website?

In regards to SEO, is a site map important for a small 3 page website? I understand that it is not needed for the convenience of a user visiting the site, but will it help the search engines find it?
7
votes
1answer
108 views

How to tell which URLs have fallen out of search engine index

I've had a few pages trimmed from google's indexed number on my sitemap in webmaster tools. How can I tell which pages have been dropped?
7
votes
1answer
180 views

Solution for large scale site maps

I'm working on a nationwide retail web site with thousands of categories and product pages and my client wants to move from a single sitemap to multiple sitemaps based on page categorization. Here is ...
6
votes
1answer
368 views

Google anonymous sitemap submission

By searching for "How to submit a sitemap to Google" you can find dozens of links, and all of'em truly explain the how to very well. But all of'em start with this first step: Login to your Google ...
6
votes
1answer
104 views

If a website is accessed on HTTPS instead of HTTP, should the URLs on the sitemap be HTTPS or HTTP?

I have changed my website from HTTP to HTTPS. At this moment, I have the next rewrite rule working to redirect calls for HTTP to HTTPS: RewriteEngine On RewriteCond %{SERVER_PORT} 80 RewriteRule ...
6
votes
4answers
3k views

Google Webmaster Tools says my XML sitemap “appears to be an HTML page”

We're running a lot of sites and we've started to get a lot of these errors in Webmaster Tools: Sitemap is HTML Your Sitemap appears to be an HTML page. Please use a supported sitemap format ...
6
votes
2answers
2k views

Google doesn't seem to update the description or title of my homepage

Before we launched our website, we had set up a "coming soon" page and google picked up the title and description from its contents. So the description in the search results said, "Coming soon! Visit ...
6
votes
4answers
279 views

Prevent XML sitemaps from showing up in Google search results

How do I prevent my XML sitemap files from showing up in Google search results like this result of a site: search query: I don't understand why Google would choose to show sitemap files in search ...
6
votes
1answer
110 views

Does Google reprocesses submitted sitemaps from time to time?

Assuming one submits a sitemap for a website in Google Webmaster, does Google reprocess it from time to time? If yes, at which rate?
6
votes
1answer
713 views

Can I host a sitemap on another domain?

Just out of curiosity, I have developed a small app analyzing and generating sitemaps for a given domain. Can I tell search engines to look for the sitemap of a given domain on my app using a ...
6
votes
1answer
3k views

Will an incorrect change frequency in my XML sitemap harm my website?

What happens if I set the change frequency of a page to daily and don't update it daily? Will this make search engine blacklist my site? What is the accepted changefreq to balance search indexing ?
6
votes
2answers
156 views

Submit example.com/#!/page URLs to Google

On a HTML5 website, there is a single page, index.php . Its code contains other 5 pages. An AJAX navigation is used, so the URL of other page looks like example.com/#!/page_Example. I had tried to ...
6
votes
1answer
672 views

Are there specific advantages or disadvantages of an XML sitemap over a TXT based sitemap?

Are there any specific advantages or disadvantages in generating an XML based sitemap in place of a simple txt based sitemap (list of URLs)? I realize that in the XML format I can set priority and ...
6
votes
1answer
218 views

In Google Webmaster Tools we have 3 sitemaps attributed to 1 domain

I have a website that has been on the internet for almost 10 years created in "Microsoft FrontPage" with over 900 pages. Currently in Google Webmaster tools it shows up as 2 domains and 3 sitemaps: ...
6
votes
1answer
2k views

How long does Bingbot typically take to process a sitemap submission?

I submitted a domain's sitemap.xml to Bingbot (in Webmaster Tools). It's been a couple of days but the status is still pending. Does anyone know how much time does Bing Webmaster Tools takes to ...
6
votes
2answers
224 views

How frequently does Googlebot fetch sitemaps? Does it depend on PageRank?

How frequently does Google fetch sitemaps? I am now working with a high traffic website that normally has 30 new posts per minute. It currently it provides a sitemap which only includes the 100 ...
5
votes
5answers
357 views

How can I fix Google indexing URLs that are not part of my sitemap?

Using site:example.com in Google is returning many results with the following format: https://www.w.example.com/services/edison/16mm-to-2k Obviously this is not what I submitted and is not part of my ...
5
votes
6answers
907 views

Is SEO and sitemap really important?

Is the sitemap really important? I ask this because I couldn't see the sitemaps of big websites such as Twitter, Facebook and others... The sitemap should be at "/sitemap.xml", "/sitemap.xml.gz" or ...
5
votes
6answers
390 views

Looking for a sitemap generator

I am looking for a good way to generate a sitemap for my current site. I inherited a huge site at work and we are going to start the process of IA analysis and redesign. It would be awesome if there ...
5
votes
2answers
867 views

Does sitemap.xml contain links to the entire site?

I read up on the limitations and how you can link multiple sitemaps. But my question is, are they to contain links to EVERYTHING or just the most recent X thousand changes?
5
votes
3answers
189 views

Is submitting a sitemap an outdated technique for SEO?

I'm not getting more content or recommendations for sitemap practice in SEO. Is submitting a sitemap an outdated practice in SEO or is it necessary to submit a sitemap for SERP?
5
votes
3answers
2k views

How long does it take for Google Webmasters to index site after submitting sitemap? [duplicate]

Possible Duplicate: Why isn't my website in Google search results? I have submitted my website today into Google search using Google Webmasters using sitemaps. The status on the ...
5
votes
2answers
530 views

How to submit sitemap to Baidu?

I've some pages in my site in Chinese but I don't understand Chinese (it's some GIS data). Is there any way to submit sitemap to Baidu?
5
votes
3answers
1k views

Sitemap: Hierarchical layout possible?

Is it possible to design my sitemap hierarchically? My site is laid out hierarchically into World=>Continent=>Country=>State=>City=>Articles Can I design my sitemap xml like ...
5
votes
1answer
621 views

Do I reference all my *.xml.gz sitemap files in robots.txt

I have a website with over 1 million url's. As such, I have 1 sitemap.xml file which acts as an index to many sitemap0000.xml.gz, sitemap0001.xml.gz ... sitemap0030.xml.gz etc. files. My question is: ...
5
votes
1answer
422 views

RSS vs Sitemap for SEO

What are the differences of the two and how can they help in SEO? I'm creating a custom-scripted CMS and I'm thinking if should I either add RSS/Sitemap/Both?
5
votes
1answer
505 views

Sitemap XML version vs simple text (urls list) version, do you know what are the pros?

I usualy submit simple text urls list as sitemap on Google webmaster tools. It's just a matter of simplicity, a simple text file is lightweight, easier to read also for humans (actually for me). :) ...
5
votes
2answers
68 views

Is it necessary to submit sitemap to www and non www?

I have submitted my website to Google Webmaster Tools with both www and with no-www. I had made the domain without www to my preffered domain and have submitted a sitemap. My question is should I ...
5
votes
1answer
931 views

SEO: Make hashtag links look static

So I have a website which displays all my content vertically. (like modern websites often do these days). Thus I can't create static links to each section. I'm currently handling the scrolling with ...
5
votes
1answer
67 views

If I use the same image on multiple pages, should it be on my sitemap multiple times?

Following Google's guide to Image sitemaps <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" ...