• About Us
  • Privacy & Policy
  • Contact
The Magazine Times
  • Home
  • News
    • All
    • Business
    Why you need a business coach

    Why you need a business coach

    How to Build a Recruitment Agency Software in 4 Easy Steps

    Can You Hire A Real Estate Agent To Help You Find The rental property?

    The 5 Greatest Innovation Patterns In 2023 Everybody Should Prepare For the present

    WPS Queries

    WPS Queries Answered

    Can You Hire A Real Estate Agent To Help You Find The rental property?

    Precisely what is Good for Obligation testing?

    Trading Index In Australia

    The Various Advantages Of Trading Index In Australia

    Trending Tags

  • Tech
    • All
    • Apps
    • Gadget
    • Mobile
    • Startup
    YouTube Video Downloader Online for Long Videos

    YouTube Video Downloader Online for Long Videos

    mechanical keyboard

    Why use a mechanical keyboard?

    VR Games

    Best Multiplayer VR Games in 2023

    WHAT IS THE DIFFERENCE BETWEEN Mbps & MBps? (Megabits per second and Megabytes per second)

    WHAT IS THE DIFFERENCE BETWEEN Mbps & MBps? (Megabits per second and Megabytes per second)

    How to Leverage Social Media to Boost Holiday Sales

    Recover Data from Dead SSD Laptop?

    Apple Phone Repair

    How to Avoid Overpaying for Apple Phone Repair in Hialeah?

    Trending Tags

  • Entertainment
    • All
    • Gaming
    • Sports
    Animal Crossing

    Animal Crossing: New Horizons is the title of the current instalment in the series

    Encanto – A Disney Movie Trivia Quiz

    Encanto – A Disney Movie Trivia Quiz

    Veibae Face – Is Veibae Face a Voice Changer?

    Veibae Face – Is Veibae Face a Voice Changer?

    How to Get the Most Out of an Instagram Influencer

    How to Get the Most Out of an Instagram Influencer

    Unblocked Games

    Unblocked Games

    Sonic 2 Game Review

    Sonic 2 Game Review

  • Lifestyle
    • All
    • Fashion
    • Food
    • Health & Fitness
    • Travel
    Necklace Chains

    Know About the Types of Necklace Chains

    Dog Breeds

    Top 15 Herding Dog Breeds in 2023

    Waterproof Hoods Jackets

    This winter, give your employees the warmth they deserve with these 5 goodies!

    Hair Loss Treatment

    Neo Hair Moisturizer – The Best Hair Regrowth Arrangement

    Photo Album

    Know the Relation between Memories and Photo Album Online

    surf resort

    Benefits of getting a package for a surf resort

    Trending Tags

  • Review
    themelbwinestore.com.a

    The Melbourne Wine Store: Opening Hours, Taste Wines Review (2022)

     Cheapest NBA 2K22 MT 

    Guaranteed dark matter packs are included in the NBA 2K22 version of MyTeam

    Disneyplus com/begin – Enter Code for Smart TV

    Disneyplus com/begin – Enter Code for Smart TV

    Roof Racks For Adventure Vehicles: 7 Benefits

    Danger Warning for Diesel Owners

    Adminlinked.Com: Is It Real or Fake?

    Adminlinked .Com: Is It Real or Fake?

    Yayoins Review

    Yayoins Review: Is Yayoins legit or Not?

  • Celebrity
  • Digital Marketing
  • Education
No Result
View All Result
  • Home
  • News
    • All
    • Business
    Why you need a business coach

    Why you need a business coach

    How to Build a Recruitment Agency Software in 4 Easy Steps

    Can You Hire A Real Estate Agent To Help You Find The rental property?

    The 5 Greatest Innovation Patterns In 2023 Everybody Should Prepare For the present

    WPS Queries

    WPS Queries Answered

    Can You Hire A Real Estate Agent To Help You Find The rental property?

    Precisely what is Good for Obligation testing?

    Trading Index In Australia

    The Various Advantages Of Trading Index In Australia

    Trending Tags

  • Tech
    • All
    • Apps
    • Gadget
    • Mobile
    • Startup
    YouTube Video Downloader Online for Long Videos

    YouTube Video Downloader Online for Long Videos

    mechanical keyboard

    Why use a mechanical keyboard?

    VR Games

    Best Multiplayer VR Games in 2023

    WHAT IS THE DIFFERENCE BETWEEN Mbps & MBps? (Megabits per second and Megabytes per second)

    WHAT IS THE DIFFERENCE BETWEEN Mbps & MBps? (Megabits per second and Megabytes per second)

    How to Leverage Social Media to Boost Holiday Sales

    Recover Data from Dead SSD Laptop?

    Apple Phone Repair

    How to Avoid Overpaying for Apple Phone Repair in Hialeah?

    Trending Tags

  • Entertainment
    • All
    • Gaming
    • Sports
    Animal Crossing

    Animal Crossing: New Horizons is the title of the current instalment in the series

    Encanto – A Disney Movie Trivia Quiz

    Encanto – A Disney Movie Trivia Quiz

    Veibae Face – Is Veibae Face a Voice Changer?

    Veibae Face – Is Veibae Face a Voice Changer?

    How to Get the Most Out of an Instagram Influencer

    How to Get the Most Out of an Instagram Influencer

    Unblocked Games

    Unblocked Games

    Sonic 2 Game Review

    Sonic 2 Game Review

  • Lifestyle
    • All
    • Fashion
    • Food
    • Health & Fitness
    • Travel
    Necklace Chains

    Know About the Types of Necklace Chains

    Dog Breeds

    Top 15 Herding Dog Breeds in 2023

    Waterproof Hoods Jackets

    This winter, give your employees the warmth they deserve with these 5 goodies!

    Hair Loss Treatment

    Neo Hair Moisturizer – The Best Hair Regrowth Arrangement

    Photo Album

    Know the Relation between Memories and Photo Album Online

    surf resort

    Benefits of getting a package for a surf resort

    Trending Tags

  • Review
    themelbwinestore.com.a

    The Melbourne Wine Store: Opening Hours, Taste Wines Review (2022)

     Cheapest NBA 2K22 MT 

    Guaranteed dark matter packs are included in the NBA 2K22 version of MyTeam

    Disneyplus com/begin – Enter Code for Smart TV

    Disneyplus com/begin – Enter Code for Smart TV

    Roof Racks For Adventure Vehicles: 7 Benefits

    Danger Warning for Diesel Owners

    Adminlinked.Com: Is It Real or Fake?

    Adminlinked .Com: Is It Real or Fake?

    Yayoins Review

    Yayoins Review: Is Yayoins legit or Not?

  • Celebrity
  • Digital Marketing
  • Education
No Result
View All Result
The Magazine Times
No Result
View All Result
Home Tech

Monitor the web server log in real time with GOACCESS

ackleyadam8@gmail.com by ackleyadam8@gmail.com
April 28, 2022
in Tech
0
Monitor the web server log in real time with GOACCESS
0
SHARES
29
VIEWS
Share on FacebookShare on Twitter

Real-time analysis of the web server log with GOACCESS

GOACCESS is a small analysis tool to be installed on the Linux web server that allows you to monitor log data in real time through a report visible both via the SSH console and in an HTML file.

In a previous article I explained why it is important to analyze the web server log and how to analyze it with Excel. Today we see HOW to analyze it in real time with a small server-side software called GOACCESS .

Index:

 

  • Install GOACCESS
  • Configure GOACCESS
  • View the LOG in real time via SSH
  • Save the log in HTML
  • Update the report via crontab
  • View the LOG in real time via HTML
  • Extra commands

To install GOACCESS you need to have root access to the web server via SSH.

Install GOACCESS

I created this guide while installing GOACCESS on my server which is based on Ubuntu and uses NGINX as a web server . For installations in different environments, refer to the official website or to the repository on Github .

To install GOACCESS on Ubuntu connect via SSH console to your web server. The following instructions allow you to install the latest version of the software.

Now that you have GOACCESS installed you need to configure it to help interpret the log format. Apache in fact has a slightly different format than Nginx which in turn is different from other logs.

Configure GOACCESS

In particular, it is necessary to configure the time-format , date-format and log-format . These instructions tell GOACCESS how to read the log strings and extract the time, date and information entered in the log.

The GOACCESS configuration file is usually found here: /etc/goaccess.conf, depending on the type of installation you have done you can also find it in / usr / etc / or / usr / local / etc /.

To edit the file type in the SSH console

According to your web server you have to enter the 3 parameters seen above. For Nginx web server add these three lines or, if present, remove the comment “#”:

For Apache web server use this configuration:

Attention, uncomment only one log-format based on your installation, do not enable both!

View the LOG in real time via SSH

You are now ready to launch GOACCESS and view the data in real time. GOACCESS was born as a tool to be used via SSH, so let’s see how to view the log from the console. First of all you have to locate your logs, in my environment I find them under: / var / log / nginx / .

Now that we know where the log is, just run GOACCESS from the command line:

  • The -f parameter is used to indicate the path of the log file
  • The -a parameter allows you to view the user agents
  • The -m parameter enables the mouse in the dashboard

Replace the log name with your own! Also remember that the real-time log is the most recent (access.log) but nothing prevents you from opening a previously saved log (for example access.log.3).

The dashboard contains the critical information extracted from the web server log:

  • Total Requests
  • Unique Visitors
  • Unique Files
  • Referrers
  • Valid Requests
  • Processed Time
  • Static Files
  • Log Size
  • Failed Requests
  • IP Hits
  • Unique 404
  • Bandwidth
  • Log File Location
  • Unique visitors per day – Including spiders
  • Requested Files (URL)
  • Static Requests
  • Not Found (URLs)
  • Visitors Hostname and IPs
  • Operating Systems
  • Browsers
  • Time Distribution
  • Referring SItes
  • Geo Location
  • HTTP Status Codes

The data is updated in real time, run a scan with Screaming Frog to verify. You can use quick commands to navigate the dashboard data:

  • F1 / h: help
  • F5: window refresh
  • q: to exit GOACCESS or to close the active module
  • o / ENTER: expand the highlighted module
  • 0-9 and Shift + 0: set the active module
  • j: Scroll down within the active module
  • k: Scroll up within the active form
  • c: change the color scheme
  • ^ f: Scroll forward within the active form
  • ^ b: Scroll backward within the active form
  • TAB: switch from one module to another (next)
  • SHIFT + TAB: switch between modules (back)
  • s: Active form options
  • /: search the form via Regex
  • n: searches for the position of the next occurrence
  • g: to move to the first element of the page
  • G: to move to the last element of the page

Save the log in HTML

In case you don’t like using the dashboard via SSH you can always export the report in HTML.

You must specify a path for the HTML file, which has the right permissions and which is reachable not only from localhost. In my case the string is the following:

Here you can see a demo of the GOACCESS HTML report.

To refresh the report you need to run the command again or create a cronjob.

Update the report via crontab

From the SSH console type

crontab -e

select the editor you prefer (advice nano or vim) and add a line following this logic:

This cronjob updates the report every hour. Save the link to the report.html so you can view it updated whenever you want, without having to log into the server via SSH.

View the LOG in real time via HTML

GOACCESS also allows you to view a report in real time simply by typing this command:

  • The -oserver parameter to send the output to another file (HTML, JSON or CSV).
  • The –real-time-htmlparameter activates the real-time report.
  • The –ws-urlparameter is optional, it is used to view the report on a host other than the monitored server. The address of the host without http is entered as an attribute of the parameter.

Real-time log analysis

Extra commands

Below I have collected some console commands that are useful for launching filtered analysis of the web server log. Remember to change the path to your log file.

GOACCESS also allows you to export reports in JSON and CSV

To generate the report in JSON:

To export to CSV:

Through the Grep function it is possible to filter, for example, only the hits of Googlebot :

To process only the last log:

To process all historical logs:

To process today’s data only:

To process Googlebot only:

To process AMP pages only:

To process just one page:

Here you will find more examples. What software do you use to monitor the web server log in real time?

Previous Post

Advantages of Wood Burning Stove Installation Shropshire?

Next Post

URLs Match.eu SEO copywriting tool

ackleyadam8@gmail.com

ackleyadam8@gmail.com

My name is Adam and I am a professional blogger. I have searched out different niches and brought up amazing results. Contact me via e-mail at ackleyadam8@gmail.com

Next Post
URLs Match.eu SEO copywriting tool

URLs Match.eu SEO copywriting tool

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Stay Connected test

  • Trending
  • Comments
  • Latest
Watch Ni Main Sass Kutni Punjbai Movie

Where to Watch Ni Main Sass Kutni Punjbai Movie Online

May 16, 2022
A-Lovely-Crypto-Wallet-Web-3.0-Dapp-Browser

A Lovely Crypto Wallet & Web 3.0 Dapp Browser

May 11, 2022
Paula Dietz

Paula Dietz (Dennis Rader’s Ex-wife) – Bio, Wiki, Age, Death

September 7, 2021
What is Hanahaki Disease

What is Hanahaki Disease? – Is it Reality or a Myth?

September 7, 2021
How to Make a Pakistani Dress Cut and Sew at Home

How to Make a Pakistani Dress Cut and Sew at Home

1
YouTube Video Downloader Online for Long Videos

YouTube Video Downloader Online for Long Videos

0
The Top 7 Tile Trends we Watched in 2021

The Top 7 Tile Trends we Watched in 2021

0
kitchen

Tips To Maintain The Perfect Kitchen

0
YouTube Video Downloader Online for Long Videos

YouTube Video Downloader Online for Long Videos

January 26, 2023
Why you need a business coach

Why you need a business coach

January 26, 2023
mechanical keyboard

Why use a mechanical keyboard?

January 25, 2023

How to Build a Recruitment Agency Software in 4 Easy Steps

January 25, 2023

Recent News

YouTube Video Downloader Online for Long Videos

YouTube Video Downloader Online for Long Videos

January 26, 2023
7
Why you need a business coach

Why you need a business coach

January 26, 2023
6
mechanical keyboard

Why use a mechanical keyboard?

January 25, 2023
6

How to Build a Recruitment Agency Software in 4 Easy Steps

January 25, 2023
4
The Magazine Times

Here at The Magazine Times, we share the latest news and helpful guides to our visitors. So, Stay Connected with us for the quality informational blogs.

Follow Us

Browse by Category

  • Apps
  • Business
  • Celebrity
  • Digital Marketing
  • Education
  • Entertainment
  • Fashion
  • Food
  • Gadget
  • Gaming
  • General
  • Health & Fitness
  • Home Improvement
  • Lifestyle
  • Mobile
  • News
  • Review
  • Sports
  • Startup
  • Tech
  • Travel
  • Uncategorized

Recent News

YouTube Video Downloader Online for Long Videos

YouTube Video Downloader Online for Long Videos

January 26, 2023
Why you need a business coach

Why you need a business coach

January 26, 2023
  • About Us
  • Privacy & Policy
  • Contact

© The Magazine Times Copyright 2021. All Rights Reserved.

No Result
View All Result

© The Magazine Times Copyright 2021. All Rights Reserved.