Does anyone know a good way of getting a list of all the URI elements for a website? I plan on moving a website to a new CMS and would like to setup some 301 redirects for articles, images, css, and js files that will be moved to a new location.

I'm looking for somewhat of a "site sucker" application that creates a list of URI elements for a website, instead of downloading them.

1 Answer 1


You can try xenu it will crawl your website and find all links. The report is in HTML but I think you will be able to extract the links with some kind of regexp.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.