Webmasters Stack Exchange is a question and answer site for pro webmasters. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I am looking for a good way to generate a sitemap for my current site. I inherited a huge site at work and we are going to start the process of IA analysis and redesign. It would be awesome if there was some way to crawl the site and automatically generate a sitemap with all of our pages. Does anyone know of any good resources?



locked by Stephen Ostermiller May 1 '15 at 18:53

This question exists because it has historical significance, but it is not considered a good, on-topic question for this site, so please do not use it as evidence that you can ask similar questions here. This question and its answers are frozen and cannot be changed. More info: help center.

Is the site running on any kind of CMS? There may be a better platform-specific solution if so. – Anonymous Jun 28 '12 at 8:59
up vote 8 down vote accepted

For sitemap generation I use GSiteCrawler it works great and it gives you a lot of additional information. If you're looking to do additional analysis I use Xenu link Sleuth it's main purpose is to help you find broken links but it also gives a lot of IA related info such as depth from the home page, internal links pointing at certain pages etc. Both tools are free.

+1 excellent apps, thanks for sharing! – Marco Demaio Jul 25 '11 at 19:45

Here is a link to a free solution... http://www.xml-sitemaps.com/

May not be what you are looking for but it saves you from coding a script to do the job for you.

Thanks for the suggestion. Actually I already hit them up, but having more than 500 pages made it not a viable solution. – Purcell Oct 21 '10 at 19:34

Googling "xml sitemap generator" found plenty of resources.


Is the website running PHP?

I made a PHP script for myself some time ago. Let a comment if is the case and I give the 4shared link.


I highly recommend Microsys A1 Sitemap Generator, it crawls your website and shows potential problems like broken links, duplicate content, duplicate titles, everything you need to know to make your website better. And then when everything is fixed it creates a sitemap with a click of a button.


For $4 I got a PHP script from Code Canyon (http://codecanyon.net/item/php-site-map-and-google-sitemap/49131) and it will automatically update your sitemap. I also added a line to my .htaccess file so /sitemap.php will be rewritten to /sitemap.xml. If you want to take it one step further, you can find PHP scripts that will automatically ping search engines with your new sitemap, although Google and Bing are the only search engines left that let users ping the websites and their spiders can crawl websites daily.


protected by John Conde Jun 27 '12 at 2:50

Thank you for your interest in this question. Because it has attracted low-quality or spam answers that had to be removed, posting an answer now requires 10 reputation on this site (the association bonus does not count).

Would you like to answer one of these unanswered questions instead?

Not the answer you're looking for? Browse other questions tagged or ask your own question.