Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

I am looking for a good way to generate a sitemap for my current site. I inherited a huge site at work and we are going to start the process of IA analysis and redesign. It would be awesome if there was some way to crawl the site and automatically generate a sitemap with all of our pages. Does anyone know of any good resources?


share|improve this question
Is the site running on any kind of CMS? There may be a better platform-specific solution if so. –  Anonymous Jun 28 '12 at 8:59

6 Answers 6

up vote 8 down vote accepted

For sitemap generation I use GSiteCrawler it works great and it gives you a lot of additional information. If you're looking to do additional analysis I use Xenu link Sleuth it's main purpose is to help you find broken links but it also gives a lot of IA related info such as depth from the home page, internal links pointing at certain pages etc. Both tools are free.

share|improve this answer
+1 excellent apps, thanks for sharing! –  Marco Demaio Jul 25 '11 at 19:45

Here is a link to a free solution... http://www.xml-sitemaps.com/

May not be what you are looking for but it saves you from coding a script to do the job for you.

share|improve this answer
Thanks for the suggestion. Actually I already hit them up, but having more than 500 pages made it not a viable solution. –  Purcell Oct 21 '10 at 19:34

Googling "xml sitemap generator" found plenty of resources.

share|improve this answer

Is the website running PHP?

I made a PHP script for myself some time ago. Let a comment if is the case and I give the 4shared link.

share|improve this answer

I highly recommend Microsys A1 Sitemap Generator, it crawls your website and shows potential problems like broken links, duplicate content, duplicate titles, everything you need to know to make your website better. And then when everything is fixed it creates a sitemap with a click of a button.

share|improve this answer

For $4 I got a PHP script from Code Canyon (http://codecanyon.net/item/php-site-map-and-google-sitemap/49131) and it will automatically update your sitemap. I also added a line to my .htaccess file so /sitemap.php will be rewritten to /sitemap.xml. If you want to take it one step further, you can find PHP scripts that will automatically ping search engines with your new sitemap, although Google and Bing are the only search engines left that let users ping the websites and their spiders can crawl websites daily.

share|improve this answer

protected by John Conde Jun 27 '12 at 2:50

Thank you for your interest in this question. Because it has attracted low-quality answers, posting an answer now requires 10 reputation on this site.

Would you like to answer one of these unanswered questions instead?

Not the answer you're looking for? Browse other questions tagged or ask your own question.