• About Us
  • Privacy & Policy
  • Contact
The Magazine Times
  • Home
  • News
    • All
    • Business
    Businesses

    Choosing the Right Recruitment Agency in Dubai: Tips and Insights

    Businesses

    LiftMyScore: Elevating Your Credit Score Game

    Run a Restaurant

    How to Run a Restaurant: Insider Tips and Proven Strategies?

    Businesses

    4 Rewarding Businesses That You Can Start in 2023

    Petrol Chainsaw

    The Four Compelling Advantages of Using a Petrol Chainsaw

    Move

    6 Tips to Plan Your Commercial Move

    Trending Tags

  • Tech
    • All
    • Apps
    • Gadget
    • Mobile
    • Startup
    Cell Phone Repair

    Cell Phone Repair in Ennis, TX: Gadget E.R. Repair to the Rescue

    Activate and Enjoy on Roku’s Platform

    Activate and Enjoy on Roku’s Platform

    Important Car Safety Features

    The Five Most Vital Automobile Safety Features

    Recruitment Agency Software

    The Significance of Custom Software Development in Digital Transformation

    instagram

    10 Instagram Stories Hacks You Need to Know in 2023

    AC Zoning

    AC Zoning: Discover the Benefits and Suitability for Your Home

    Trending Tags

  • Entertainment
    • All
    • Gaming
    • Sports
    Escapology Blvd Suite

    Escaping the Ordinary: Unusual Escape Room Themes You Must Try

    Movies Online

    Get HD Quality Hiidude Movies Online

    dinosaurs

    For what reason do kids love dinosaurs?

    free minecraft account and password

    Get free minecraft record and secret phrase 2022 – Get Data Here!

    Pros and cons of renting audio equipment

    Animal Crossing

    Animal Crossing: New Horizons is the title of the current instalment in the series

  • Lifestyle
    • All
    • Fashion
    • Food
    • Health & Fitness
    • Travel
    Physiotherapy Doctor

    The Healing Hands: Exploring the Role of a Physiotherapy Doctor

    Corteiz Clothing

    Eternal Elegance: Corteiz Clothing’s Everlasting Allure

    Weight

    Four Incontestable Signs to Start Your Weight Loss Journey

    Express Yourself with Chrome Hearts: The Ultimate Clothing Experience

    Express Yourself with Chrome Hearts: The Ultimate Clothing Experience

    role in marriage

    Marriage Counseling Questions: Real Tips to Enhance Your Counseling Experience

    Effortless Umrah: 10 Proven Tips for a Hassle-Free Journey

    Trending Tags

  • Review
    themelbwinestore.com.a

    The Melbourne Wine Store: Opening Hours, Taste Wines Review (2022)

     Cheapest NBA 2K22 MT 

    Guaranteed dark matter packs are included in the NBA 2K22 version of MyTeam

    Disneyplus com/begin – Enter Code for Smart TV

    Disneyplus com/begin – Enter Code for Smart TV

    Roof Racks For Adventure Vehicles: 7 Benefits

    Danger Warning for Diesel Owners

    Adminlinked.Com: Is It Real or Fake?

    Adminlinked .Com: Is It Real or Fake?

    Yayoins Review

    Yayoins Review: Is Yayoins legit or Not?

  • Celebrity
  • Digital Marketing
  • Education
No Result
View All Result
  • Home
  • News
    • All
    • Business
    Businesses

    Choosing the Right Recruitment Agency in Dubai: Tips and Insights

    Businesses

    LiftMyScore: Elevating Your Credit Score Game

    Run a Restaurant

    How to Run a Restaurant: Insider Tips and Proven Strategies?

    Businesses

    4 Rewarding Businesses That You Can Start in 2023

    Petrol Chainsaw

    The Four Compelling Advantages of Using a Petrol Chainsaw

    Move

    6 Tips to Plan Your Commercial Move

    Trending Tags

  • Tech
    • All
    • Apps
    • Gadget
    • Mobile
    • Startup
    Cell Phone Repair

    Cell Phone Repair in Ennis, TX: Gadget E.R. Repair to the Rescue

    Activate and Enjoy on Roku’s Platform

    Activate and Enjoy on Roku’s Platform

    Important Car Safety Features

    The Five Most Vital Automobile Safety Features

    Recruitment Agency Software

    The Significance of Custom Software Development in Digital Transformation

    instagram

    10 Instagram Stories Hacks You Need to Know in 2023

    AC Zoning

    AC Zoning: Discover the Benefits and Suitability for Your Home

    Trending Tags

  • Entertainment
    • All
    • Gaming
    • Sports
    Escapology Blvd Suite

    Escaping the Ordinary: Unusual Escape Room Themes You Must Try

    Movies Online

    Get HD Quality Hiidude Movies Online

    dinosaurs

    For what reason do kids love dinosaurs?

    free minecraft account and password

    Get free minecraft record and secret phrase 2022 – Get Data Here!

    Pros and cons of renting audio equipment

    Animal Crossing

    Animal Crossing: New Horizons is the title of the current instalment in the series

  • Lifestyle
    • All
    • Fashion
    • Food
    • Health & Fitness
    • Travel
    Physiotherapy Doctor

    The Healing Hands: Exploring the Role of a Physiotherapy Doctor

    Corteiz Clothing

    Eternal Elegance: Corteiz Clothing’s Everlasting Allure

    Weight

    Four Incontestable Signs to Start Your Weight Loss Journey

    Express Yourself with Chrome Hearts: The Ultimate Clothing Experience

    Express Yourself with Chrome Hearts: The Ultimate Clothing Experience

    role in marriage

    Marriage Counseling Questions: Real Tips to Enhance Your Counseling Experience

    Effortless Umrah: 10 Proven Tips for a Hassle-Free Journey

    Trending Tags

  • Review
    themelbwinestore.com.a

    The Melbourne Wine Store: Opening Hours, Taste Wines Review (2022)

     Cheapest NBA 2K22 MT 

    Guaranteed dark matter packs are included in the NBA 2K22 version of MyTeam

    Disneyplus com/begin – Enter Code for Smart TV

    Disneyplus com/begin – Enter Code for Smart TV

    Roof Racks For Adventure Vehicles: 7 Benefits

    Danger Warning for Diesel Owners

    Adminlinked.Com: Is It Real or Fake?

    Adminlinked .Com: Is It Real or Fake?

    Yayoins Review

    Yayoins Review: Is Yayoins legit or Not?

  • Celebrity
  • Digital Marketing
  • Education
No Result
View All Result
The Magazine Times
No Result
View All Result
Home Tech

Monitor the web server log in real time with GOACCESS

ackleyadam8@gmail.com by ackleyadam8@gmail.com
April 28, 2022
in Tech
0
Monitor the web server log in real time with GOACCESS
0
SHARES
42
VIEWS
Share on FacebookShare on Twitter

Real-time analysis of the web server log with GOACCESS

GOACCESS is a small analysis tool to be installed on the Linux web server that allows you to monitor log data in real time through a report visible both via the SSH console and in an HTML file.

In a previous article I explained why it is important to analyze the web server log and how to analyze it with Excel. Today we see HOW to analyze it in real time with a small server-side software called GOACCESS .

Index:

 

  • Install GOACCESS
  • Configure GOACCESS
  • View the LOG in real time via SSH
  • Save the log in HTML
  • Update the report via crontab
  • View the LOG in real time via HTML
  • Extra commands

To install GOACCESS you need to have root access to the web server via SSH.

Install GOACCESS

I created this guide while installing GOACCESS on my server which is based on Ubuntu and uses NGINX as a web server . For installations in different environments, refer to the official website or to the repository on Github .

To install GOACCESS on Ubuntu connect via SSH console to your web server. The following instructions allow you to install the latest version of the software.

Now that you have GOACCESS installed you need to configure it to help interpret the log format. Apache in fact has a slightly different format than Nginx which in turn is different from other logs.

Configure GOACCESS

In particular, it is necessary to configure the time-format , date-format and log-format . These instructions tell GOACCESS how to read the log strings and extract the time, date and information entered in the log.

The GOACCESS configuration file is usually found here: /etc/goaccess.conf, depending on the type of installation you have done you can also find it in / usr / etc / or / usr / local / etc /.

To edit the file type in the SSH console

According to your web server you have to enter the 3 parameters seen above. For Nginx web server add these three lines or, if present, remove the comment “#”:

For Apache web server use this configuration:

Attention, uncomment only one log-format based on your installation, do not enable both!

View the LOG in real time via SSH

You are now ready to launch GOACCESS and view the data in real time. GOACCESS was born as a tool to be used via SSH, so let’s see how to view the log from the console. First of all you have to locate your logs, in my environment I find them under: / var / log / nginx / .

Now that we know where the log is, just run GOACCESS from the command line:

  • The -f parameter is used to indicate the path of the log file
  • The -a parameter allows you to view the user agents
  • The -m parameter enables the mouse in the dashboard

Replace the log name with your own! Also remember that the real-time log is the most recent (access.log) but nothing prevents you from opening a previously saved log (for example access.log.3).

The dashboard contains the critical information extracted from the web server log:

  • Total Requests
  • Unique Visitors
  • Unique Files
  • Referrers
  • Valid Requests
  • Processed Time
  • Static Files
  • Log Size
  • Failed Requests
  • IP Hits
  • Unique 404
  • Bandwidth
  • Log File Location
  • Unique visitors per day – Including spiders
  • Requested Files (URL)
  • Static Requests
  • Not Found (URLs)
  • Visitors Hostname and IPs
  • Operating Systems
  • Browsers
  • Time Distribution
  • Referring SItes
  • Geo Location
  • HTTP Status Codes

The data is updated in real time, run a scan with Screaming Frog to verify. You can use quick commands to navigate the dashboard data:

  • F1 / h: help
  • F5: window refresh
  • q: to exit GOACCESS or to close the active module
  • o / ENTER: expand the highlighted module
  • 0-9 and Shift + 0: set the active module
  • j: Scroll down within the active module
  • k: Scroll up within the active form
  • c: change the color scheme
  • ^ f: Scroll forward within the active form
  • ^ b: Scroll backward within the active form
  • TAB: switch from one module to another (next)
  • SHIFT + TAB: switch between modules (back)
  • s: Active form options
  • /: search the form via Regex
  • n: searches for the position of the next occurrence
  • g: to move to the first element of the page
  • G: to move to the last element of the page

Save the log in HTML

In case you don’t like using the dashboard via SSH you can always export the report in HTML.

You must specify a path for the HTML file, which has the right permissions and which is reachable not only from localhost. In my case the string is the following:

Here you can see a demo of the GOACCESS HTML report.

To refresh the report you need to run the command again or create a cronjob.

Update the report via crontab

From the SSH console type

crontab -e

select the editor you prefer (advice nano or vim) and add a line following this logic:

This cronjob updates the report every hour. Save the link to the report.html so you can view it updated whenever you want, without having to log into the server via SSH.

View the LOG in real time via HTML

GOACCESS also allows you to view a report in real time simply by typing this command:

  • The -oserver parameter to send the output to another file (HTML, JSON or CSV).
  • The –real-time-htmlparameter activates the real-time report.
  • The –ws-urlparameter is optional, it is used to view the report on a host other than the monitored server. The address of the host without http is entered as an attribute of the parameter.

Real-time log analysis

Extra commands

Below I have collected some console commands that are useful for launching filtered analysis of the web server log. Remember to change the path to your log file.

GOACCESS also allows you to export reports in JSON and CSV

To generate the report in JSON:

To export to CSV:

Through the Grep function it is possible to filter, for example, only the hits of Googlebot :

To process only the last log:

To process all historical logs:

To process today’s data only:

To process Googlebot only:

To process AMP pages only:

To process just one page:

Here you will find more examples. What software do you use to monitor the web server log in real time?

Previous Post

Advantages of Wood Burning Stove Installation Shropshire?

Next Post

URLs Match.eu SEO copywriting tool

ackleyadam8@gmail.com

ackleyadam8@gmail.com

My name is Adam and I am a professional blogger. I have searched out different niches and brought up amazing results. Contact me via e-mail at ackleyadam8@gmail.com

Next Post
URLs Match.eu SEO copywriting tool

URLs Match.eu SEO copywriting tool

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Stay Connected test

  • Trending
  • Comments
  • Latest
Watch Ni Main Sass Kutni Punjbai Movie

Where to Watch Ni Main Sass Kutni Punjbai Movie Online

May 16, 2022
A-Lovely-Crypto-Wallet-Web-3.0-Dapp-Browser

A Lovely Crypto Wallet & Web 3.0 Dapp Browser

May 11, 2022
Paula Dietz

Paula Dietz (Dennis Rader’s Ex-wife) – Bio, Wiki, Age, Death

September 7, 2021
What is Hanahaki Disease

What is Hanahaki Disease? – Is it Reality or a Myth?

September 7, 2021
How to Make a Pakistani Dress Cut and Sew at Home

How to Make a Pakistani Dress Cut and Sew at Home

1
Cell Phone Repair

Cell Phone Repair in Ennis, TX: Gadget E.R. Repair to the Rescue

0
Juana Ahumada

Juana Ahumada Bio – Age, Networth, Husband

0
Paula Dietz

Paula Dietz (Dennis Rader’s Ex-wife) – Bio, Wiki, Age, Death

0
Cell Phone Repair

Cell Phone Repair in Ennis, TX: Gadget E.R. Repair to the Rescue

September 27, 2023
Businesses

Choosing the Right Recruitment Agency in Dubai: Tips and Insights

September 23, 2023
Physiotherapy Doctor

The Healing Hands: Exploring the Role of a Physiotherapy Doctor

September 22, 2023
Escapology Blvd Suite

Escaping the Ordinary: Unusual Escape Room Themes You Must Try

September 21, 2023

Recent News

Cell Phone Repair

Cell Phone Repair in Ennis, TX: Gadget E.R. Repair to the Rescue

September 27, 2023
3
Businesses

Choosing the Right Recruitment Agency in Dubai: Tips and Insights

September 23, 2023
6
Physiotherapy Doctor

The Healing Hands: Exploring the Role of a Physiotherapy Doctor

September 22, 2023
9
Escapology Blvd Suite

Escaping the Ordinary: Unusual Escape Room Themes You Must Try

September 21, 2023
11
The Magazine Times

Here at The Magazine Times, we share the latest news and helpful guides to our visitors. So, Stay Connected with us for the quality informational blogs.

Follow Us

Browse by Category

  • Apps
  • Automotive
  • Business
  • Celebrity
  • Digital Marketing
  • Education
  • Entertainment
  • Fashion
  • Food
  • Gadget
  • Gaming
  • General
  • Health & Fitness
  • Home Improvement
  • Lifestyle
  • Mobile
  • News
  • Review
  • Sports
  • Startup
  • Tech
  • Travel
  • Uncategorized

Recent News

Cell Phone Repair

Cell Phone Repair in Ennis, TX: Gadget E.R. Repair to the Rescue

September 27, 2023
Businesses

Choosing the Right Recruitment Agency in Dubai: Tips and Insights

September 23, 2023
  • About Us
  • Privacy & Policy
  • Contact

© The Magazine Times Copyright 2023. All Rights Reserved.

No Result
View All Result

© The Magazine Times Copyright 2023. All Rights Reserved.