|visits||member for||3 years|
|seen||Mar 20 '13 at 13:22|
Is there a spider / link checker that can start deep inside a login-protected site
I have used wget in the past, but wasn't familiar with the load-cookies option. I'll try this out and report back!
Just overhauled our entire site. How do I keep Google, Bing and Yahoo from demoting us?
Thanks for pointing out the sites.txt typo. That was supposed to say "site map and robots.txt." Edited