Welcome Guest.   Make a donation to an author on the site December 20, 2014, 11:29:47 PM  *

Please login or register.
Or did you miss your validation email?


Login with username and password (forgot your password?)
Why not become a lifetime supporting member of the site with a one-time donation of any amount? Your donation entitles you to a ton of additional benefits, including access to exclusive discounts and downloads, the ability to enter monthly free software drawings, and a single non-expiring license key for all of our programs.


You must sign up here before you can post and access some areas of the site. Registration is totally free and confidential.
 
Read the Practical Guide to DonationCoder.com Forum Search Features
   
   Forum Home   Thread Marks Chat! Downloads Search Login Register  
Pages: [1]   Go Down
  Reply  |  New Topic  |  Print  
Author Topic: Any webserver-desktop-logfile-analysis-Software recommendations?  (Read 5066 times)
crono
Charter Honorary Member
***
Posts: 178


see users location on a map View Profile Give some DonationCredits to this forum member
« on: September 07, 2006, 05:34:36 AM »

Hello everyone,

Im searching a programm for analyse my Apache-Access Logfiles. On the server Im using http://www.awstats.net/ but I want something which is not web-based. Any recommendations?
Logged
mouser
First Author
Administrator
*****
Posts: 33,790



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #1 on: September 07, 2006, 08:15:36 AM »

ive used a ton and will try to post some thoughts later - am also interested in other people's views.
Logged
Gothi[c]
DC Server Admin
Charter Honorary Member
***
Posts: 857



see users location on a map View Profile WWW Give some DonationCredits to this forum member
« Reply #2 on: September 07, 2006, 08:43:45 AM »

please do post some,.. the only one i tried was a php thing and it was crap cheesy
Logged
Renegade
Charter Member
***
Posts: 11,964



Tell me something you don't know...

see users location on a map View Profile WWW Give some DonationCredits to this forum member
« Reply #3 on: September 07, 2006, 10:55:12 PM »

Analog - Web Storming - ClickTrax - Urchin - roll your own...

The best solution is to actually roll your own. That way you get to include real business logic.

Web log analysis is at best sketchy and doesn't provide you with "true" numbers. They are only a rough guess. (Another reason to roll your own.)

The best solution is to run things on the client for detection and store it on the server in a database. You also get the added advantage of only storing what you need.

All large scale web analysis must be done this way because logs get too large to process. Even on a relatively small site (or medium depending on what you consider large) you can have log files that are GBs for a day. Very small sites have log files in the 10's of MB per day.

Most software can't keep up with that kind of volume. That's where a dataserver can solve the problem. They're optimized to deal with data processing whereas your average log analysis software just can't compare. (A lot of resources go into optimizing RDBMSs like MS SQL Server, DB2, Informix, Oracle, etc.)

But for small sites this can often be overkill. A quick over view with Analog is good for most people with hobby sites or small web sites.

I'm not a fan of AwStats. I've found it just miserable to work with.

Another thing you can do is to write a program to dump your logs into a DB then just use pure SQL to ask questions. That's a cheap and easy way, though it is a bit time consuming as you'll still end up waiting for queries. But the quality of answers you can get is VERY high.
Logged

Slow Down Music - Where I commit thought crimes...

Freedom is the right to be wrong, not the right to do wrong. - John Diefenbaker
crono
Charter Honorary Member
***
Posts: 178


see users location on a map View Profile Give some DonationCredits to this forum member
« Reply #4 on: September 11, 2006, 06:49:36 PM »

Thanks you very much Renegade. What you write sounds really experienced. I think Im going to roll my own - which shouldnt be to hard... Parsing into a DB and running some SQL should be straight forward smiley
Logged
mouser
First Author
Administrator
*****
Posts: 33,790



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #5 on: September 11, 2006, 08:25:47 PM »

i guess my view would be the opposite to renegade's.  the idea of rolling my own when sooo much work has been done on this seems a bit crazy.

i also tend to like local apps, and there are some good ones for the pc (Mach 5 Analyzer is pretty nice and fast).

though its true that if you start getting 1gb log files, these programs start to choke and you need to find alternative strategies.
Logged
Gothi[c]
DC Server Admin
Charter Honorary Member
***
Posts: 857



see users location on a map View Profile WWW Give some DonationCredits to this forum member
« Reply #6 on: September 12, 2006, 04:32:24 AM »

I didn't like analog too much.
I'd much rather see something in between rolling your own and not, that is:
  a commandline utility that runs in a terminal that will sort through the logs as they come in, with colored output and statistics, as opposed to web-based solutions. grep'ing through the logs and using tail -f works too, but i'd like to see it better formatted, with a pretty ncurses interface or something. just like htop looks nicer than top smiley And it'd be handy to have counters of pageviews (even though they don't mean anything), failed requests, intrusions, etc,..
Maybe with pluggable progressbar-like-meters as in htop. smiley
Logged
housetier
Charter Honorary Member
***
Posts: 1,321


see users location on a map View Profile Give some DonationCredits to this forum member
« Reply #7 on: September 12, 2006, 01:55:50 PM »

Today I found Logfilter: An Apache Log Filter.

Logfilter is a tool for performing ad-hoc filtering of apache website log files.

This seems to be tightly coupled to the Apache Webserver.
Logged
mouser
First Author
Administrator
*****
Posts: 33,790



see users location on a map View Profile WWW Read user's biography. Give some DonationCredits to this forum member
« Reply #8 on: September 12, 2006, 02:13:22 PM »

house i've been looking for something like that for a while, nice find. thumbs up
Logged
Terry
Charter Member
***
Posts: 25


View Profile WWW Give some DonationCredits to this forum member
« Reply #9 on: September 16, 2006, 03:18:27 PM »

AlterWind Log Analyzer - http://www.alterwind.com
Logged
kartal
Supporting Member
**
Posts: 1,529


View Profile Give some DonationCredits to this forum member
« Reply #10 on: August 18, 2008, 07:22:27 PM »

I like Alterwind, it is neat. I also am looking one for that also shows the cities in different countries rather than only countries.

AlterWind Log Analyzer - http://www.alterwind.com
Logged
Pages: [1]   Go Up
  Reply  |  New Topic  |  Print  
 
Jump to:  
   Forum Home   Thread Marks Chat! Downloads Search Login Register  

DonationCoder.com | About Us
DonationCoder.com Forum | Powered by SMF
[ Page time: 0.036s | Server load: 0.01 ]