AWStats Revision as of Sunday, 20 December 2015 at 19:56 UTC

Pre-Flight

Installation

   mv /etc/awstats/{awstats.model.conf,model.conf}

Since I’m setting up analytics for a blog at http://blog.example.com,

   cp /etc/awstats/{awstats.conf,awstats.blog.example.com.conf}
   mkdir -p /var/lib/awstats/blog.example.com

Then modified these params

   LogFile="/var/log/nginx/blog.access.log"
   SiteDomain="blog.example.com"
   HostAliases="blog.example.com localhost 127.0.0.1"
   DNSLookup=1
   DirData="/var/lib/awstats/blog.example.com"
   EnableLockForUpdate=1

Generate the database files with

   /usr/local/awstats/tools/awstats_updateall.pl now

Scan for any errors, fix accordingly. You can now see a text file (the
‘database’ file) in /var/lib/awstats/blog.example.com

The logrotate issue

I configured logrotate to compress my logfiles. This can be problematic,
but has a simple solution: tell AWStats to update its data files
before logrotate does anything with them.

So,

   /var/log/nginx/*.log {
       daily
       missingok
       rotate 52
       compress
       delaycompress
       notifempty
       create 640 nginx adm
       sharedscripts
       prerotate
           /usr/local/awstats/tools/awstats_updateall.pl now
       endscript
       postrotate
           [ -f /var/run/nginx.pid ] && kill -USR1 `cat /var/run/nginx.pid`
       endscript
   }

Cron entry

This generates the static HTML pages. Since my logrotate config runs
daily, I’ll set the job to run at that frequency as well.

I added this to /etc/cron.daily/awstats-blog:

#!/bin/bash
STATIC_DIR="/var/www/html/stats"

YEAR=$(date +"%Y")
MONTH=$(date +"%m")
LOG_DIR=$STATIC_DIR/$YEAR/$MONTH

mkdir -p $LOG_DIR
/usr/local/awstats/tools/awstats_buildstaticpages.pl -dir=$LOG_DIR -config=blog.example.com -update

Don’t forget to make it executable and try it out :)

Importing historic log data

Generating data files

I had previous logfiles in /var/log/nginx that looked like this as a
result of logrotate:

   blog.access.log-20130625.gz
   blog.access.log-20130626.gz
   blog.access.log-20130628.gz
   blog.access.log-20130701.gz
   blog.access.log-20130703.gz
   blog.access.log-20130704.gz
   blog.access.log-20130705.gz

To import these, I removed the AWStats database files in
/var/lib/awstats/blog. I then temporarily changed the “LogFile”
parameter in the config file (/etc/awstats/awstats.blog.example.conf)
to this:

   LogFile="zcat /var/log/nginx/blog.access.log*.gz |"

Should be self-exlanatory. Then ran the update script as usual:

   /usr/local/awstats/tools/awstats_updateall.pl now

This generated the older database entries. There are
other
methods as well, especially if
you don’t have access to your older records.

You should now regenerate the static HTML.

Regenerating static HTML pages

For the months and years you have log files for, write two small for
loops!

for YEAR in $(seq 2010 2013); do
    for MONTH in $(seq --format="%02g" 5 8); do
        STATSDIR=/var/www/html/stats/$YEAR/$MONTH
        mkdir -p $STATSDIR
        /usr/local/awstats/tools/awstats_buildstaticpages.pl -dir=$STATSDIR -month=$MONTH -year=$YEAR -config=blog.example.com
    done
done

Ta da!

Plugins

GeoIP

Will be much faster than DNS. A little painful, but worth it

Perl Module

You’ll need the C API first.

   # Get the latest source (1.5+)
   wget -O - http://www.maxmind.com/download/geoip/api/c/GeoIP-latest.tar.gz | tar -xvzf -
   cd GeoIP-1.5.1
   ./configure; make; make install

   # Make sure CPAN can find the compiled libs
   echo "/usr/local/lib" > /etc/ld.so.conf.d/GeoIP.conf
   /sbin/ldconfig /etc/ld.so.conf -v

You should be able to install this now via CPAN, but the module’s
Makefile is screwed up (at least as of version 1.42). So download
directly and compile:

   wget -O - http://search.cpan.org/CPAN/authors/id/B/BO/BORISZ/Geo-IP-1.42.tar.gz | tar -xzvf -
   cd Geo-IP-1.42
   perl Makefile.PL LIBS="-L/usr/local/lib -lGeoIP" INC=-I/usr/local/include
   make
   make install

Database File

   mkdir /opt/GeoIP
   wget -O - http://geolite.maxmind.com/download/geoip/database/GeoLiteCountry/GeoIP.dat.gz | gunzip - > /opt/GeoIP/data

Now uncomment this in your site config (also uncomment DNSLookup):

   LoadPlugin="geoip GEOIP_STANDARD /opt/GeoIP/data"

Run the update script!

Other notes

References

Category: Nikhil’s Notes
Category: Installation Logs
Category: Linux