Webmasters Stack Exchange is a question and answer site for pro webmasters. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Does anyone know a good way of getting a list of all the URI elements for a website? I plan on moving a website to a new CMS and would like to setup some 301 redirects for articles, images, css, and js files that will be moved to a new location.

I'm looking for somewhat of a "site sucker" application that creates a list of URI elements for a website, instead of downloading them.

share|improve this question

You can try xenu it will crawl your website and find all links. The report is in HTML but I think you will be able to extract the links with some kind of regexp.

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.