Goaccess yes!
What is it ?
Goaccess is a logfile analyzer that can be used from the command prompt, no need to install a framework, get an account on a website or any other ways to waste your time. Just download it and get to work immediately.
Working with Goaccess
Recently i have discovered this great tool that helps me to get some insights about the visitors of my website. I use it to see where visitors come from and to see what content is most popular.
I can get an idea of what pages are failing or producing errors. This helps improving page ranking by crawlers like Google, Yahoo and Yandex. I have submitted my url and siteindex to these searchengines and use the webmaster tools to see the results.
Hackers
What i also learned is that people are trying to login to all kind of admin pages like php-admin, tomcat and mysql admin pages. I run fail2ban to keep people of my systems so goaccess provides me with a way to inspect how things are going. This way i could see which modules i needed to add to fail2ban and the number of attempts to login to ssh and all kind of other things have dropped.
Marketing tool
From the overview of traffic hours i can see when i have the most visitors which can help to determine what the best moment would be to post new content. In a way it can also be a marketing tool or provide insights on performance issues.
Get it now
Just login to your webserver or run it on your local machine after downloading the access.log file.
Just type 'goaccess access.log' and hit the space bar when the menu starts.
Reading the access.log
Just point goaccess to the location of the file. In this case and to be able to use it with Apache access logs, select the "NCSA Combined Log Format"
(The access.log has to be in the "combined" format. Check your Apache configuration).
Type 'goaccess access.log' to get started
Many other types of logfiles can be read and from the menu you can create your own regular expression to read a specific file.
Conclusion
While looking for a tool to provide insights on my webserver traffic I came across the Goaccess software and decided to give it. Right after completing the setup i found out that it was something i have been looking for a long while. No need to install a complete framework or connect to a cloud platform. Just download and install along with some common packages, hit enter and run!
There is support on many platforms including most favorite flavors of Linux but also BSD and OSX. CowAxess is a GoAccess implementation for Windows systems if that is your weapon of choice.
I only used goaccess for the access.log so far. My findings are based on my own configuration and setup, Debian and Apache.