A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

learn more… | top users | synonyms

166
votes
19answers
24k views

The Sitemap Paradox

We use a sitemap on Stack Overflow, but I have mixed feelings about it. Web crawlers usually discover pages from links within the site and from other sites. Sitemaps supplement this data to allow ...
57
votes
4answers
28k views

Are there any clear indicators that my sitemap file is beneficial?

I have recently created a sitemap.xml file and uploaded it to my Google Webmasters Tools account. Google didn't report any issues or errors with the uploaded sitemap of my site. Now my question is: ...
17
votes
6answers
4k views

Why did Google stop indexing pages from our sitemap.xml?

We're seeing some pages that exist in our sitemap.xml but are inexplicably missing from Google's public search index. You can't download http://superuser.com/sitemap.xml -- we protect this file ...
13
votes
4answers
351 views

easy tool for creating XML sitemaps? (constantly expanding site)

Does anyone recommend either a php script that I can run as a CRON or somekind of thirdparty tool i can use to create sitemaps? My website is events bases and so the pages are pretty ...
13
votes
1answer
1k views

Should I include everything in the sitemap or only new content?

For a website with dynamic content (new content is constantly being added), should I only include the newest content in the sitemap or should I include everything (with a sitemap index)? What are the ...
11
votes
5answers
784 views

Is it necessary/useful to build a sitemap for a small website?

I've created several small scale websites, usually for small businesses. They usually contain some information about the company, a contact form, and sometimes a few dynamic parts : news, pictures, ...
11
votes
1answer
399 views

Proper sitemap.xml setup

I have a dynamic site which has many (well, less than 50) users. Each user is allowed to create as many pages as they want. I know that there is a limit to how many pages you can be listed in ...
11
votes
3answers
2k views

How to create a good sitemap for dynamic website

I have a website with dynamic content and different kind of pages. I have some pages that rarely change, and I have pages like blogs that change often. The blog pages also have links for sorting, for ...
9
votes
1answer
288 views

using multiple sitemaps in a domain

I have a domain http://sub.example.com/. In it there is a wordpress blog at http://sub.example.com/blog and other more static content at http://sub.example.com/other, http://sub.example.com/stuff, ...
8
votes
2answers
369 views

Dynamic sitemap file

Does it matter if I serve sitemap.xml as a dynamic page? e.g., use .htaccess to rewrite sitemap.xml (or whatever static URL I submitted at the Webmaster Tools) to a PHP file. The PHP file will call ...
8
votes
4answers
2k views

& in sitemap links, are they correct?

Simple question, I'm asking just to make sure. A Google sitemap generator generated a sitemap.txt fle with links written like this: http://www.domain.com/category.htm?name=some-name&cat_id=8 ...
8
votes
2answers
551 views

Have search engines recognise multi-lingual sites

I have organised my site by language using the following structure: www.domain.com #spanish language version homepage www.domain.com/en #english language version homepage The site is of Spanish ...
7
votes
4answers
926 views

Is it possible to 'trigger' indexing on a site?

We're launching a redeveloped site soon. Google has already indexed the site that we're going to replace, but the links that google indexed are no longer applicable, because the new site has a totally ...
7
votes
2answers
2k views

Ask.com sitemap crawler down (for good)?

I have been using Ask.com as one of the search engines to ping my sitemap. When I went to ping my sitemap today to have my sitemap re-indexed, the website (http://submissions.ask.com/ping) says it no ...
7
votes
2answers
136 views

Can a sitemap change result in a drop of visits?

I recently restructured and resubmitted the sitemap for a website of mine in GWT. The old one was built by a script I acquired, which had its flaws but dit the job. After having implemented URL ...
7
votes
4answers
177 views

Sitemaps HTML and others

I am looking for the best resources on how to build sitemaps. I am currently aware of the obvious HTML sitemaps and the (google) sitemap.xml and (yahoo) urllist.txt Anyone know of resources for ...
7
votes
1answer
4k views

Does sitemap.xml have to be in the root directory?

This may be a simple and absurd question, but is it completely necessary for sitemap.xml file to be in the root directory of the wordpress install directory of the site, or is it ok to create a ...
7
votes
1answer
138 views

Should the urls in the sitemap contain the slug?

I'm coding the sitemap logic of my side-project blogging platform and I would like to know if omitting the slug in the <loc> nodes of the sitemap could be a problem for the crawlers. Having two ...
7
votes
6answers
217 views

In regards to SEO, is a site map important for a small 3 page website?

In regards to SEO, is a site map important for a small 3 page website? I understand that it is not needed for the convenience of a user visiting the site, but will it help the search engines find it?
7
votes
1answer
105 views

How to tell which URLs have fallen out of search engine index

I've had a few pages trimmed from google's indexed number on my sitemap in webmaster tools. How can I tell which pages have been dropped?
7
votes
1answer
159 views

Solution for large scale site maps

I'm working on a nationwide retail web site with thousands of categories and product pages and my client wants to move from a single sitemap to multiple sitemaps based on page categorization. Here is ...
6
votes
1answer
333 views

Google anonymous sitemap submission

By searching for "How to submit a sitemap to Google" you can find dozens of links, and all of'em truly explain the how to very well. But all of'em start with this first step: Login to your Google ...
6
votes
2answers
1k views

How to properly use Google Webmaster Tools (for “non-www” instead of “www”)

I'm trying to use Google Webmaster Tools correctly: I don't use the www in my website's URL, but just noticed that I must have entered the www when I originally added my site to Webmaster Tools a few ...
6
votes
1answer
76 views

If a website is accessed on HTTPS instead of HTTP, should the URLs on the sitemap be HTTPS or HTTP?

I have changed my website from HTTP to HTTPS. At this moment, I have the next rewrite rule working to redirect calls for HTTP to HTTPS: RewriteEngine On RewriteCond %{SERVER_PORT} 80 RewriteRule ...
6
votes
1answer
102 views

Does Google reprocesses submitted sitemaps from time to time?

Assuming one submits a sitemap for a website in Google Webmaster, does Google reprocess it from time to time? If yes, at which rate?
6
votes
1answer
3k views

Will an incorrect change frequency in my XML sitemap harm my website?

What happens if I set the change frequency of a page to daily and don't update it daily? Will this make search engine blacklist my site? What is the accepted changefreq to balance search indexing ?
6
votes
2answers
114 views

Submit example.com/#!/page URLs to Google

On a HTML5 website, there is a single page, index.php . Its code contains other 5 pages. An AJAX navigation is used, so the URL of other page looks like example.com/#!/page_Example. I had tried to ...
6
votes
1answer
564 views

Are there specific advantages or disadvantages of an XML sitemap over a TXT based sitemap?

Are there any specific advantages or disadvantages in generating an XML based sitemap in place of a simple txt based sitemap (list of URLs)? I realize that in the XML format I can set priority and ...
6
votes
1answer
192 views

In Google Webmaster Tools we have 3 sitemaps attributed to 1 domain

I have a website that has been on the internet for almost 10 years created in "Microsoft FrontPage" with over 900 pages. Currently in Google Webmaster tools it shows up as 2 domains and 3 sitemaps: ...
6
votes
1answer
1k views

How long does Bingbot typically take to process a sitemap submission?

I submitted a domain's sitemap.xml to Bingbot (in Webmaster Tools). It's been a couple of days but the status is still pending. Does anyone know how much time does Bing Webmaster Tools takes to ...
5
votes
6answers
853 views

Is SEO and sitemap really important?

Is the sitemap really important? I ask this because I couldn't see the sitemaps of big websites such as Twitter, Facebook and others... The sitemap should be at "/sitemap.xml", "/sitemap.xml.gz" or ...
5
votes
6answers
373 views

Looking for a sitemap generator

I am looking for a good way to generate a sitemap for my current site. I inherited a huge site at work and we are going to start the process of IA analysis and redesign. It would be awesome if there ...
5
votes
2answers
793 views

Does sitemap.xml contain links to the entire site?

I read up on the limitations and how you can link multiple sitemaps. But my question is, are they to contain links to EVERYTHING or just the most recent X thousand changes?
5
votes
3answers
1k views

Sitemap: Hierarchical layout possible?

Is it possible to design my sitemap hierarchically? My site is laid out hierarchically into World=>Continent=>Country=>State=>City=>Articles Can I design my sitemap xml like ...
5
votes
2answers
98 views
+50

How to submit sitemap to Baidu?

I've some pages in my site in Chinese but I don't understand Chinese (it's some GIS data). Is there any way to submit sitemap to Baidu?
5
votes
1answer
553 views

Do I reference all my *.xml.gz sitemap files in robots.txt

I have a website with over 1 million url's. As such, I have 1 sitemap.xml file which acts as an index to many sitemap0000.xml.gz, sitemap0001.xml.gz ... sitemap0030.xml.gz etc. files. My question is: ...
5
votes
1answer
352 views

RSS vs Sitemap for SEO

What are the differences of the two and how can they help in SEO? I'm creating a custom-scripted CMS and I'm thinking if should I either add RSS/Sitemap/Both?
5
votes
1answer
493 views

Sitemap XML version vs simple text (urls list) version, do you know what are the pros?

I usualy submit simple text urls list as sitemap on Google webmaster tools. It's just a matter of simplicity, a simple text file is lightweight, easier to read also for humans (actually for me). :) ...
5
votes
1answer
774 views

SEO: Make hashtag links look static

So I have a website which displays all my content vertically. (like modern websites often do these days). Thus I can't create static links to each section. I'm currently handling the scrolling with ...
5
votes
1answer
522 views

Can I host a sitemap on another domain?

Just out of curiosity, I have developed a small app analyzing and generating sitemaps for a given domain. Can I tell search engines to look for the sitemap of a given domain on my app using a ...
5
votes
1answer
49 views

If I use the same image on multiple pages, should it be on my sitemap multiple times?

Following Google's guide to Image sitemaps <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" ...
5
votes
2answers
208 views

How frequently does Googlebot fetch sitemaps? Does it depend on PageRank?

How frequently does Google fetch sitemaps? I am now working with a high traffic website that normally has 30 new posts per minute. It currently it provides a sitemap which only includes the 100 ...
5
votes
1answer
110 views

How to create google video sitemap urls for very large video files with distinct segments?

I have a large video files about 1 hr in duration, with different sections of the video corresponding to different distinct sub topics . For example, the whole video may be about an yoga exercise ...
4
votes
6answers
2k views

How to tell Google that I have changed my website URLs?

I have done major updates to my website, and renamed all my URLs. How can I tell Google that I have renamed these URLs and let Google refresh its index? My website URL: http://www.pndmasr.com/ My ...
4
votes
3answers
2k views

How long does it take for Google Webmasters to index site after submitting sitemap? [duplicate]

Possible Duplicate: Why isn't my website in Google search results? I have submitted my website today into Google search using Google Webmasters using sitemaps. The status on the ...
4
votes
2answers
254 views

Is it possible to find out whether one given page has been indexed?

When one submits sitemaps in Google Webmaster, Google may not index all pages of your site/blog. Is there a way to find out whether one specific page belonging to the sitemap has been indexed or not? ...
4
votes
4answers
1k views

Are HTML sitemaps important from a SEO perspective?

Are HTML sitemaps (like this one http://www.google.com/sitemap.html) important from a SEO perspective, or is uploading an XML to Google enough? Beside from visualizing a data structure for the user, ...
4
votes
3answers
155 views

How do you figure out a large site link/structure?

Suppose you're re-designing an existing large site. The first thing to do is to figure out how the site is structured, how many links, pages, sub domains, etc. Is there a tool you can use to crawl a ...
4
votes
3answers
1k views

Sitemap to display hash tag links or not?

I am just creating sitemap for my site and wanted to find out if I should include # links for SEO? For Example: www.mydomain.com/#comment1 www.mydomain.com/#comment2 Does this help with SEO or ...
4
votes
2answers
146 views

What document types can be included in an XML sitemap?

AFAIK, Google accepts sitemaps which are about ordinary URLs (text/plain), images (image/png, image/gif, image/jpg, etc.), and videos (video/avi, video/mpeg, etc.). My question is, how many Internet ...