Archive for December 23rd, 2008

free web log analyzer “Visitors” 10000 line in 1 seconds

Visitors – fast web log analyzer

http://www.hping.org/visitors/

 

How To install

wget http://www.hping.org/visitors/visitors-0.7.tar.gz
tar xvzf visitors-0.7.tar.gz
cd visitors_0.7
make
cp visitors /usr/bin/

 

Usege

like: visitors -A -m 30 access.log -o html > report.htm
like: visitors -A -m 30 access.log -o html –trails –prefix http://howto.net > report.html 

 

make flowchart with Graphviz
http://www.graphviz.org/Download..php

 

How To install

wget http://dag.wieers.com/rpm/packages/graphviz/graphviz-2.2-1.2.el4.rf.i386.rpm

rpm -ivh graphviz-2.2-1.2.el4.rf.i386.rpm 

 

Usege

1, make graph.dot
visitors access.log –prefix http://sample.net -V > graph.dot

2, make PNG image
dot -Tpng graph.dot > graph.png

 

for better use
visitors -GKZWMRDXYS -m 30 access_log –trails –prefix http://sample.net -o html > `date –date ‘1 day ago’ +%Y%m%d`report.html

visitors access_log –prefix http://gigazine.net -V > graph.dot

dot -Tpng graph.dot > `date –date ‘1 day ago’ +%Y%m%d`graph.png

check linux bottleneck

1, CPU usage

use top, w or vmstat

 

2, memory usage

top or free

 

3, disk I/0

vmstat 1 5

 

4, number of tcp connections

netstat -an | wc -l