I have a huge list of IP addresses recorded from various visitors to a website. A huge amount of the visitors, in some months over 70%, came from IP addresses that contained keywords such as google, yahoo, bot, crawler, etc.
Does this mean that those users were infact search engine crawlers?
If so, why are their so many crawlers in my visitor records in comparison to genuine human visitors? (and if not what's the explanation?)
Thanks in advance.
Here's a few examples of the data: