I have noticed something very strange on the site I'm working on. We currently only show
http://www.example.com. The URL
http://www.example.com/ (slash at the end) gets 301'd to
Now this is all very standard stuff except I noticed that "Screaming Frog" (an SEO tool) refused to crawl my site. When I spoke to their tech team they said it was because I was 301ing the slash to the non-slash and I "should fix that error".
To me that makes no sense as I thought many other sites such
BBC.com and even
google.com get rid of the trailing slash for the root domain.
However on closer inspection I don't think they're using either 301 or 302 HTTP responses. Because when I use http://web-sniffer.net/ to test
www.google.com/ I get a 200 response AS well as
www.google.com. However when I view
www.google.com/ there is NO trailing slash. How does this happen?