On my sites I am seeing requests for what would be valid URLs, but with the path converted to lowercase.
For example, a valid URL is
In my Apache logs I'm seeing
This is happening on several sites I manage, and I cannot see any pattern in the user agent.
An example log entry:
18.104.22.168 - - [24/Jan/2017:06:36:57 +0000] "GET /educational-assessments-cat12p0.html HTTP/1.1" 404 6011 "http://www.example.com" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_2) AppleWebKit/537.75.14 (KHTML, like Gecko) Version/7.0.3 Safari/537.75.14"
UA can be Win/OSX/iOS/Android etc and many different browsers.
The sites all run on LAMP stack. I use mod_rewrite to convert
CAT12P0.html to a query string to pass to a PHP file.
I have of course checked my source HTML and sitemaps and all links are uppercase at the end as mod_rewrite expects.
Is this a bad bot, or could I be doing something to tell UAs to convert my links to lowercase?