Take the 2-minute tour ×
Webmasters Stack Exchange is a question and answer site for pro webmasters. It's 100% free, no registration required.

When i check the traffic on my website, the top IP's have have statistics like this.

> IP           Page       Hits

> 91.212.x.x   7123        7123

> 91.x.x.x      249        249

These visits are for one month. Since the number of pages match number of hits, does it mean these IPs belong to robots? And how it can be the same? I do have pages which have does not have images which will give one hit but still. How it can occur?

share|improve this question

1 Answer 1

up vote 3 down vote accepted

Yes, the IP addresses in your logs probably belong to bots.

If the bot is set to only download html, and not request any other resources (javascript, images, etc), each page view will correspond to a single hit.

Most bots (indexing spiders, screen-scrapers, vulnerability hunters) will only be interested in the HTML, so this looks like typical bot behaviour.

share|improve this answer
1  
+1 though you seem to mean web scrapers versus screen scrapers (which would necessarily download images at least once) –  danlefree Aug 1 '11 at 11:35
    
Indeed - web scrapers. I've never heard the origins of the term 'screen scraper' before, but it makes perfect sense. –  Ciaran Aug 2 '11 at 1:40

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.