The process of recording diagnostic information, usually for the purposes of debugging and monitoring the status or "health" of various systems.

learn more… | top users | synonyms

2
votes
1answer
188 views

Is there a way to know if apache receives a request from a public IP not local to your country?

I'm looking for ways to know if an apache server receives a request , from another country (e.g germany) considering its a fair request (no spam , or proxies). I want it either to appear this as a ...
1
vote
1answer
16 views

Why do I see requests from BOT/0.1 (BOT for JCE) in my server access log and what should I do about them?

My server keeps getting requests with user agent identified as BOT/0.1 (BOT for JCE). The first one arrived 2013-09-14 22:13:17 CEST, the last one yet about three days ago, 2014-08-12 06:05:39 CEST. ...
0
votes
1answer
36 views

How to build a list from Postfix maillog

I want to build a list from maillog, maillog.x containing something like Date, Sender's email, Recipient's Email and subject of the message filtering output emails and output domain. I've read about ...
1
vote
1answer
629 views

Why are nonexistant files listed in the TRANSFER log?

This snippit from my apache log reflects some piece of malware casually browsing through my site for some unknown purpose. The most puzzling thing to me is that the GET address doesn't correspond ...
0
votes
0answers
15 views

Searching for Googlebot in server logs [closed]

I'm trying to use Heorku Logentries to track Googlebot's activity on my server. (Although, I think this could broadly apply to tracking Googlebot activity on any server.) I can see that I have results ...
3
votes
1answer
36 views

Do server stat tools work with CDNs?

If I pick a hosting package that offers CDN support, then how do server stat tools work, since web pages are served by different servers from all over the world? Can I rely on them in that case?
1
vote
1answer
47 views

How can I log a user's actual IP address instead of CloudFlare's?

My raw access log is now filled with CloudFlare IP addresses. Is there any way I can use a .htacess file or configure the server to log the user's actual IP address? With PHP, CloudFlare creates ...
1
vote
1answer
41 views

I've noticed a bizarre (malicious?) behavior in my website logs

My website logs spit out "invalid content" messages -- they typically occur when someone types in a wrong hyperlink or a page has mistakenly changed URLs. Lately (about 20 times per day) I've been ...
1
vote
1answer
59 views

favicon 404 in access log, but favicon is there

Going through 404 error on my site, I have noticed a bunch of problems with favicons: /apple-touch-icon-120x120.png /apple-touch-icon-120x120-precomposed.png /apple-touch-icon-152x152.png ...
1
vote
1answer
14 views

Trendmicro clones authenticated requests - showing up in my error logs

I'm having various errors, from unauthenticated requests for using some AJAX requests (which need authentication). While I have clients from Belgium, the IP addresses match a IP in the form of ...
1
vote
1answer
30 views

Appending Apache log files with the date

I used to use cronolog to manage my Apache log files. However, after getting back into website hosting, I noticed it is no longer being updated. I want to append the date of the log file, so I have ...
0
votes
0answers
24 views

Server error log question

I keep getting this error log message below. How can I fix? [:warn] [pid 29746] (104)Connection reset by peer: [client 157.55.35.77:34179] mod_fcgid: ap_pass_brigade failed in handle_request_ipc ...
0
votes
1answer
130 views

Nginx writing separately to two different logs

I've recently taken over as Sysadmin of a site, and the first thing I noticed was that there were two Nginx access_logs defined: access.log and access_new.log, and they were both being written to. ...
28
votes
3answers
2k views

Files I should have on every website

I would like to have a list of files that should exist on every website. The idea is to please most browsers and bots and get down with the number of 404 messages in the logs. So far I have the ...
7
votes
3answers
310 views

How do large sites like StackOverflow handle their access logs?

I'm wondering how large sites like StackOverflow handle their access logs. A write to the disk on every request seems a little bit uneconomical, but is Google Analytics that reliable to use it as your ...
1
vote
1answer
509 views

How to prevent wpad.dat entries in log file

My Nginx access.log is FULL with lines about /wpad.dat (on a completely empty site with only "index.php") : 190.199.220.124 - - [13/Aug/2013:22:37:04 +0000] "GET /wpad.dat HTTP/1.1" 200 731 "-" ...
2
votes
3answers
5k views

Apache logs: “::1 … ”OPTIONS * HTTP/1.0" 200 -

Just looking at logs of a not-so-busy site on one of our Apache servers and notice tons of these in the log: ::1 - - [15/Apr/2011:12:11:40 -0700] "OPTIONS * HTTP/1.0" 200 - ::1 - - ...
1
vote
0answers
64 views

How to customize apache mod_sec log output?

I have an apache server which uses mod_security configuration. Those logs are further analyzed and sent out to OSSEC server for intrusion detection and monitoring. That OSSEC server then sends those ...
10
votes
2answers
301 views

Clients requesting garbled URLs

I've noticed some odd 404s which appear to be broken URL rewriting code. Our image viewer requests tiles using URLs like this: /media/204/service/dzi/1/1_files/7/0_0.jpg I see some - well under ...
2
votes
1answer
71 views

Why would someone log everything you do on their website?

I was searching on Google and I clicked on 1 of the ads related to my search, I noticed on that website that every time I do something like scrolling or selecting text there is a request sent to a ...
1
vote
1answer
675 views

How do I make Apache stop logging “ ModSecurity: Access denied”?

I have Apache set up on a Linux server and have mod_security enabled. I have a few lines that look like: SecRule REQUEST_URI "^/*admin" drop,phase:1 Because there is no /admin on my website, and I ...
6
votes
4answers
4k views

Is it possible to use Google Analytics to track file downloads?

It's always bothered me that Google Analytics (and similar embedded web traffic monitoring services) can only see a reflection of the traffic going to my server and can only see page visits since it ...
-1
votes
0answers
17 views

AWStats configuration issue [closed]

I have a an Ubuntu 12.04.2 LTS server in which i host my website. The website is in Drupal. I tried to set up AWStats for my website but it is giving a lot of problems. I followed this link - ...
1
vote
1answer
608 views

Best practices for serving multiple sites with Apache2 [closed]

I have a server with a number of virtual hosts. Over the last couple of years I have continually been improving on most parts of serving these sites, everything from how and where to do logging, how ...
2
votes
1answer
1k views

http://www.example.com/http://www.example.com/ in Apache log?

I run a website, let's say www.example.com. On it I have a path and file, say www.example.com/path/file.html. The Apache log lists GET requests like: GET /path/file.html HTTP/1.1 Which is correct, ...
0
votes
1answer
106 views

Analyzing logs: how to get page views broken down by page?

I have a WordPress site where we didn't enable "pretty" permalinks, and thus, all pages in it have URLs in the form ?p=3921. Now, when I log into the statistics page in my hosting provider, I see that ...
1
vote
2answers
40 views

detailed access statistics for audio files

We have an external hosting company for our video files. They provide us with detailed access statistics e.g. The duration how long how many people have seen a specific video. This is quite ...
5
votes
2answers
108 views

Garbled text in server logs

I recently looked over my server's logs and I found a bunch of garbled text. Here is a link to the full log, and here is a snapshot of what it looks like: ¹^œÌÓûFF™ÃŒ-ôÚÏàÃÒNRs§cÝi ~F#J"|³Ôq0ã~QQbA ...
25
votes
1answer
5k views

Bingbot request for trafficbasedsspsitemap.xml which does not exist

The logs for a website I manage show a request for a non-existent file by Bingbot. The details of the request are Path: /trafficbasedsspsitemap.xml Useragent: "Mozilla/5.0 (compatible; bingbot/2.0; ...
2
votes
3answers
237 views

Awstats IIS Log configuration fields extended

Good Day: We are implementing AwStat in our IIS Servers and after reading the documentation and browsing some googled results, we still have questions... so where's the best site for asking them? ...
4
votes
2answers
162 views

Track actions of paying customers

I'm looking for software that can analyze my Apache log files (or some other source) and tell me, from the visitors that actually bought something from my site, some profiling information; like time ...
0
votes
1answer
273 views

Can apache logs tell between encryped and un-encrypted traffic?

Is there a way by just looking at the apache logs you can tell if the user-credentials is encrypted or not? Meaning some kind of encryption e.g ssl or plain-text. Thanks.
2
votes
2answers
545 views

Is there a modern (eg NoSQL) web analytics solution based on log files?

I have been using Awstats for many years to process my log files. But I am missing many possibilities (like cross-domain reports) and I hate being stuck with extra fields I created years ago. ...
4
votes
5answers
855 views

Tool for clickstream anlyzing of Apache logs?

Are there any good tools to analyze the clickstream of individual users in Apache web server logs? For example, I'd like to be able to click on a visitors IP address and see all pages the user ...
2
votes
1answer
464 views

Apache logging based on user agent

I'd like to update my apache logging so that its destination is based on the user agent string or file type. Specifically, I would like to send my googlebot requests to their own log file, and I ...
0
votes
1answer
267 views

How to know in apache logs if the application has crashed?

I need some help in finding some log pattern in apache logs related to application cash? Is there a specific key word attached related to this event e.g 'crash'. Thanks.
3
votes
1answer
206 views

Reading apache logs is there a way i can know of concurnent users limit?

I want to know on a analysis layer from apache logs which can tell me if the # of concurrent logins (using same username) has exceeded e.g more then 4. Is such a thing can be automated or it requires ...
1
vote
1answer
108 views

Merge database statistics into google analytics

A couple of sites I administer have this situation: Google Analytics is set up for regular traffic reporting I have some sort of cron tab emailing/logging weekly/monthly statistics like number of ...
0
votes
1answer
83 views

Who is trying to categorize my website?

Caught this in the logs the other day: Started GET "/verify-UncategorisedWebsite?aHR0cHM6Ly93d3=" for 198.240.130.75 at 2012-12-03 14:51:50 +0000 I bumped around a bit and couldn't find anything ...
2
votes
4answers
2k views

How should I deal with user agent parsing in logs?

My web app project includes logging functionality so we can see where visitors are coming from (referrer URL), what the popular user agents are, what pages are most popular, etc. The log is stored in ...
1
vote
1answer
118 views

Alternative to Google Analytics with A/B testing and PDF scheduling

Is there a hosted solution that competes with Google Analytics and has some of the heavy hitting features: A/B testing with regression analysis Conversion tracking Funnels Schedulable reports that ...
4
votes
1answer
289 views

Undefined 404's not logging

Our custom 404 page sends us Emails to notify us of broken links. We've been lately getting emails with such a missing page: http://domain.com/undefined However, no log entries (IIS) exist on that ...
0
votes
0answers
159 views

Malicious & nonbeneficial IP address blocks (subnets) for AdWords blocking

I'm looking for a list or lists of address blocks / subnets of potentially malicious or unfruitful / known botnets or Google scrapers. The purpose of this is to help to eliminate bot clicks / scrapes ...
0
votes
1answer
60 views

Where can i get MatrixStats?

I run several IIS web servers and want to install some sort of log reader. A lot of the big boys use MatrixStats, however a good hard Google has come up blank on who makes it and/or where I can get ...
1
vote
1answer
809 views

Apache (XAMPP 1.8.0) access.log/Intrusion Detection Concern

[I originally posted on SO but it earned me a Tumbleweed badge. This looks like a better venue for the question.] I have Apache (XAMPP 1.8.0) running on Vista Pro x64. A couple times now I have seen ...
2
votes
2answers
211 views

Why does PHP create these log entries on every page access?

My server's error log (in cPanel) has an entry for every single time a PHP page is loaded that looks like this (where 'username' has been substituted for my actual username): [2012-06-09 09:02:07]: ...
0
votes
1answer
818 views

Why are Awstats, Webalizer, and Google Analytics results so different?

I realize that comparing Awstats and Webalizer to Google Analytics is like comparing apples to oranges, but each of them track at least basic statistics about visitors and pages. So why are there ...
4
votes
1answer
124 views

Exit link tracking with timestamped logs on 3rd party content

I want to track clicks on exit links, that are placed in 3rd party content, for example on Twitter. I also need the timestamps of the clicks. Google Analytics can't be embedded in 3rd party content. ...
2
votes
2answers
149 views

Is logging personally identifiable information a bad practice or violation of law?

I know we all do semi-anonymous logging (server logs, Google Analytics, etc.). However, on one of our external web applications, we have some non-reproducible errors that the external users report ...
3
votes
2answers
1k views

What is a “SiteCon” user agent?

I've found some unusual activity in my site's Apache logs and every hit has this UserAgent string: "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-gb; SiteCon/8.8.14)" What is SiteCon?