The process of recording diagnostic information, usually for the purposes of debugging and monitoring the status or "health" of various systems.

learn more… | top users | synonyms

2
votes
2answers
474 views

How to build a list from Postfix maillog

I want to build a list from maillog, maillog.x containing something like Date, Sender's email, Recipient's Email and subject of the message filtering output emails and output domain. I've read about ...
0
votes
0answers
13 views

What basic information should all websites log? [closed]

Websites tend to maintain logs that can be analyzed when things go wrong, or if they are the target of a hacking attempt, or to just gain some information about site visitors. While I am aware of this ...
1
vote
0answers
19 views

Suspiscious router log entry…please help [closed]

I noticed a strange web address in my router log. Can anyone help me understand what this is? Site allowed: redir.adap.tv] from source 192.168.1.7, Thursday, May 05,2016 11:57:27 [Site allowed: ad4....
7
votes
5answers
4k views

Is it possible to use Google Analytics to track file downloads?

It's always bothered me that Google Analytics (and similar embedded web traffic monitoring services) can only see a reflection of the traffic going to my server and can only see page visits since it ...
6
votes
5answers
1k views

Tool for clickstream anlyzing of Apache logs?

Are there any good tools to analyze the clickstream of individual users in Apache web server logs? For example, I'd like to be able to click on a visitors IP address and see all pages the user ...
1
vote
0answers
26 views

Using SetEnvIf to not log overly accessed URLs

I'm trying to figure out how to craft my SetEnvIf's in my apache config so that the server hard disk isn't spinning 24/7 over log entries. What I want to do is disable logging for all domains and ...
43
votes
7answers
124k views

What is the best Apache logs Analyzer? [closed]

What real-time log analyzer can you suggest for Apache access and error logs? There is a list of web analytics software on WikiPedia, but it would be great to hear opinions from people with ...
1
vote
0answers
10 views

change cpanel log file location

Is there a way in some configuration file to specify a new folder to put all the cpanel log files in, or is there a way to specify new log file names for each log? I ask this because I want to store ...
2
votes
1answer
81 views

How to visually see frequency of GoogleBot / BingBot access of my website from apache access logs (per 15 mins / etc)?

I am experiencing high traffic on my website at certain times of the data, at regular intervals. I am trying to determine whether GoogleBot or BingBot access of my website correlates with the high ...
2
votes
1answer
934 views

bizarre referrer in web access.log

I'm operating the http://gcc-melt.org/ website (a static website on MELT, a domain specific language to customize the GCC compiler), which should be of interest only to software developers. It is a ...
2
votes
1answer
723 views

Why are nonexistant files listed in the TRANSFER log?

This snippit from my apache log reflects some piece of malware casually browsing through my site for some unknown purpose. The most puzzling thing to me is that the GET address doesn't correspond ...
0
votes
0answers
129 views

rotating mod_security logs with rotatelog

I would like to rotate mod_security logs with rotatelogs, as this does not need a restart of the httpd, like logrotate does. However, it seems like mod_security does not want to work together with ...
1
vote
3answers
133 views

Force sending event for sessions without a logged in user

Is there any possibility using the Google Analytics API to check if the session is logged in or not? I have a problem with destination page (it is not set), and I want to resend the event when the ...
1
vote
0answers
61 views

Mysterious visits to privileged URLs from anonymous user/bot

I maintain a Rails app. Every page except login and "forgot password" requires user authentication. Yesterday I noticed entries like this one in the access logs: 54.209.60.63 - - [03/Nov/2015:19:09:...
1
vote
1answer
82 views

Many requests in my logs to the same obscure page from Opera Mini. What can be the explanation?

I checked my site's logs and I found 20 thousand requests on the same day all to an obscure page of my site. The IP address of the requests belong to Opera Mini. Can someone explain this? I would be ...
2
votes
1answer
4k views

http://www.example.com/http://www.example.com/ in Apache log?

I run a website, let's say www.example.com. On it I have a path and file, say www.example.com/path/file.html. The Apache log lists GET requests like: GET /path/file.html HTTP/1.1 Which is correct, ...
0
votes
0answers
27 views

How do I delete access logs from 2011 from AWS S3 using awscli?

I'm trying to delete all access logs from 2011 from my AWS S3 bucket. I've tried using a couple of GUI clients, but due to the large number of log files store in the bucket, they hang permanently. I'...
2
votes
1answer
703 views

How can I log a user's actual IP address instead of CloudFlare's?

My raw access log is now filled with CloudFlare IP addresses. Is there any way I can use a .htacess file or configure the server to log the user's actual IP address? With PHP, CloudFlare creates ...
1
vote
0answers
213 views

How log rotation is done in Tomcat for access logs

How log rotation is done in Tomcat ie catalina.out and access.out ? We can logrotate for catalina.out : # vim /etc/logrotate.d/tomcat7 /var/log/tomcat7/catalina.out { copytruncate daily # ...
0
votes
0answers
39 views

Calling SiteCatalyst Data Insertion API from IIS web server

I'm new to IIS. How do I configure IIS to invoke my code to process the access log information in real time? Is there a better solution than reading the log file as it's written? Apache, for instance, ...
2
votes
1answer
40 views

Is granular http logging for an application handled at the application level or the http server level?

I need to log all requests coming into the server. Typical things you would get from Apache log formatting or IIS. I am using a WSGI standards based server, Apache mod_wsgi, gunicorn, Tornado. It ...
1
vote
2answers
217 views

Disable cPanel Apache access logging by cPanel account itself?

Solutions I found through Google to disable access logging of a particular cPanel account seems to be either editing httpd.conf or having access to WHM. Is it possible for the cPanel account itself ...
3
votes
1answer
236 views

Is there a way to know if apache receives a request from a public IP not local to your country?

I'm looking for ways to know if an apache server receives a request , from another country (e.g germany) considering its a fair request (no spam , or proxies). I want it either to appear this as a ...
33
votes
4answers
3k views

Files I should have on every website

I would like to have a list of files that should exist on every website. The idea is to please most browsers and bots and get down with the number of 404 messages in the logs. So far I have the ...
1
vote
1answer
2k views

Why do I see requests from BOT/0.1 (BOT for JCE) in my server access log and what should I do about them?

My server keeps getting requests with user agent identified as BOT/0.1 (BOT for JCE). The first one arrived 2013-09-14 22:13:17 CEST, the last one yet about three days ago, 2014-08-12 06:05:39 CEST. ...
0
votes
0answers
44 views

Searching for Googlebot in server logs [closed]

I'm trying to use Heorku Logentries to track Googlebot's activity on my server. (Although, I think this could broadly apply to tracking Googlebot activity on any server.) I can see that I have results ...
3
votes
1answer
42 views

Do server stat tools work with CDNs?

If I pick a hosting package that offers CDN support, then how do server stat tools work, since web pages are served by different servers from all over the world? Can I rely on them in that case?
1
vote
1answer
47 views

I've noticed a bizarre (malicious?) behavior in my website logs

My website logs spit out "invalid content" messages -- they typically occur when someone types in a wrong hyperlink or a page has mistakenly changed URLs. Lately (about 20 times per day) I've been ...
1
vote
1answer
383 views

favicon 404 in access log, but favicon is there

Going through 404 error on my site, I have noticed a bunch of problems with favicons: /apple-touch-icon-120x120.png /apple-touch-icon-120x120-precomposed.png /apple-touch-icon-152x152.png /apple-...
1
vote
1answer
56 views

Trendmicro clones authenticated requests - showing up in my error logs

I'm having various errors, from unauthenticated requests for using some AJAX requests (which need authentication). While I have clients from Belgium, the IP addresses match a IP in the form of 150.70....
1
vote
1answer
53 views

Appending Apache log files with the date

I used to use cronolog to manage my Apache log files. However, after getting back into website hosting, I noticed it is no longer being updated. I want to append the date of the log file, so I have ...
0
votes
1answer
1k views

Nginx writing separately to two different logs

I've recently taken over as Sysadmin of a site, and the first thing I noticed was that there were two Nginx access_logs defined: access.log and access_new.log, and they were both being written to. ...
8
votes
3answers
329 views

How do large sites like StackOverflow handle their access logs?

I'm wondering how large sites like StackOverflow handle their access logs. A write to the disk on every request seems a little bit uneconomical, but is Google Analytics that reliable to use it as your ...
1
vote
1answer
2k views

How to prevent wpad.dat entries in log file

My Nginx access.log is FULL with lines about /wpad.dat (on a completely empty site with only "index.php") : 190.199.220.124 - - [13/Aug/2013:22:37:04 +0000] "GET /wpad.dat HTTP/1.1" 200 731 "-" "...
4
votes
3answers
9k views

Apache logs: “::1 … ”OPTIONS * HTTP/1.0" 200 -

Just looking at logs of a not-so-busy site on one of our Apache servers and notice tons of these in the log: ::1 - - [15/Apr/2011:12:11:40 -0700] "OPTIONS * HTTP/1.0" 200 - ::1 - - [15/Apr/2011:12:11:...
1
vote
0answers
101 views

How to customize apache mod_sec log output?

I have an apache server which uses mod_security configuration. Those logs are further analyzed and sent out to OSSEC server for intrusion detection and monitoring. That OSSEC server then sends those ...
10
votes
2answers
318 views

Clients requesting garbled URLs

I've noticed some odd 404s which appear to be broken URL rewriting code. Our image viewer requests tiles using URLs like this: /media/204/service/dzi/1/1_files/7/0_0.jpg I see some - well under <...
2
votes
1answer
83 views

Why would someone log everything you do on their website?

I was searching on Google and I clicked on 1 of the ads related to my search, I noticed on that website that every time I do something like scrolling or selecting text there is a request sent to a ...
2
votes
1answer
2k views

How do I make Apache stop logging “ ModSecurity: Access denied”?

I have Apache set up on a Linux server and have mod_security enabled. I have a few lines that look like: SecRule REQUEST_URI "^/*admin" drop,phase:1 Because there is no /admin on my website, and I ...
-1
votes
0answers
20 views

AWStats configuration issue [closed]

I have a an Ubuntu 12.04.2 LTS server in which i host my website. The website is in Drupal. I tried to set up AWStats for my website but it is giving a lot of problems. I followed this link - http://...
3
votes
1answer
2k views

Best practices for serving multiple sites with Apache2 [closed]

I have a server with a number of virtual hosts. Over the last couple of years I have continually been improving on most parts of serving these sites, everything from how and where to do logging, how ...
1
vote
1answer
143 views

Analyzing logs: how to get page views broken down by page?

I have a WordPress site where we didn't enable "pretty" permalinks, and thus, all pages in it have URLs in the form ?p=3921. Now, when I log into the statistics page in my hosting provider, I see that ...
1
vote
2answers
44 views

detailed access statistics for audio files

We have an external hosting company for our video files. They provide us with detailed access statistics e.g. The duration how long how many people have seen a specific video. This is quite ...
5
votes
2answers
133 views

Garbled text in server logs

I recently looked over my server's logs and I found a bunch of garbled text. Here is a link to the full log, and here is a snapshot of what it looks like: ¹^œÌÓûFF™ÃŒ-ôÚÏàÃÒNRs§cÝi ~F#J"|³Ôq0ã~QQbA ¼...
27
votes
1answer
5k views

Bingbot request for trafficbasedsspsitemap.xml which does not exist

The logs for a website I manage show a request for a non-existent file by Bingbot. The details of the request are Path: /trafficbasedsspsitemap.xml Useragent: "Mozilla/5.0 (compatible; bingbot/2.0; ...
2
votes
3answers
514 views

Awstats IIS Log configuration fields extended

Good Day: We are implementing AwStat in our IIS Servers and after reading the documentation and browsing some googled results, we still have questions... so where's the best site for asking them? ...
4
votes
2answers
172 views

Track actions of paying customers

I'm looking for software that can analyze my Apache log files (or some other source) and tell me, from the visitors that actually bought something from my site, some profiling information; like time ...
0
votes
1answer
1k views

Can apache logs tell between encryped and un-encrypted traffic?

Is there a way by just looking at the apache logs you can tell if the user-credentials is encrypted or not? Meaning some kind of encryption e.g ssl or plain-text. Thanks.
2
votes
2answers
712 views

Is there a modern (eg NoSQL) web analytics solution based on log files?

I have been using Awstats for many years to process my log files. But I am missing many possibilities (like cross-domain reports) and I hate being stuck with extra fields I created years ago. Anyway,...
2
votes
1answer
601 views

Apache logging based on user agent

I'd like to update my apache logging so that its destination is based on the user agent string or file type. Specifically, I would like to send my googlebot requests to their own log file, and I ...