36 reputation
1
bio website
location
age
visits member for 3 years, 1 month
seen Jan 27 at 2:07

Dec
13
asked SEO Value in redirected link?
Nov
3
comment How is crawler seeing unlinked directories / files?
It was Netsparker which is a web vulnerability scanner. Doesn't do broken links like I thought. I grabbed Xenu and that works great, but didn't show the directory in question. My guess is Netsparker is picking it up from the robots.txt file and that's the difference here.
Nov
3
awarded  Student
Nov
3
asked How is crawler seeing unlinked directories / files?