Ep. 38: Monitoring Windows Event Log and Custom Log Files with Checkmk
Read Video Transcript
|[0:00:00]||Today we start monitoring event logs and custom log files on Windows.|
|[0:00:13]||Welcome to the Checkmk Channel. Today we are taking a look at how to monitor the Windows event log and custom log files.|
|[0:00:20]||Monitoring the Windows event log is quite easy because the Windows agent actually collects all the default event logs from Windows and sends them to the Checkmk server.|
|[0:00:31]||But I'm going to show you how to handle them properly or how to direct them into the right direction to be able to monitor them.|
|[0:00:40]||Additionally, we will take a quick look at how to monitor custom log files that are not within the Windows event console. So, let's take a look at how we can configure this.|
|[0:00:50]||So, right now we are looking at a typical Windows server that has been outfitted with the Checkmk agent, and we can already see some log services here.|
|[0:01:00]||So, these come by default. The agent by default collects a certain set of messages from the Windows event log and reports them to Checkmk.|
|[0:01:09]||And for example, here we see the Security Log, which already contains 99 critical messages, and there's a lot of stuff going on here. No idea what's going on there, but there's a lot of information.|
|[0:01:21]||So, this is the default way Checkmk handles Windows log files, but it's not really a nice way to work with this because most of the time the messages are irrelevant.|
|[0:01:30]||Because in Windows, a lot of messages are logged as critical or warning as opposed to other operating systems.|
|[0:01:37]||So, you want to filter this information to a certain degree. As you can see now, we are already up to 108 critical messages, so either something's going on or nothing going on.|
|[0:01:50]||So, what we do recommend in general is to direct all the log messages from the Windows event log that we get to the event console.|
|[0:01:58]||There's a dedicated video on that topic, which you will find in the video description.|
|[0:02:04]||And that enables you to have all the log messages in a single place, and there you can very efficiently filter those messages, so make sure you only get those that are relevant for you and that you want to see.|
|[0:02:15]||To do that, we go to the Setup menu and search for the term 'forward'. And there we find the rule says Logwatch Event Console Forwarding.|
|[0:02:28]||So, I'm gonna go there, add a rule. And I only need to say Forward Messages to Event Console.|
|[0:02:35]||The defaults are fine, we don't need to change anything here in the first step. So, I'm just going to save this rule.|
|[0:02:43]||And what happens now if I go to the Windows host to the service discovery, I will find that these log services we saw earlier vanished and we get one new service called Log Forwarding, which already tells us that it forwarded seven messages from the security log.|
|[0:03:05]||So, in the first step, this simply makes your log monitoring easier because you only have one service that's really just informational telling you how many log messages have been forwarded.|
|[0:03:18]||Now let's enable that here. And starting with this activation, all messages fetched by the agent will be forwarded to the event console.|
|[0:03:28]||As you can see there are already quite some events in the event console because in preparation of this video, I already enabled the rule set we just enabled.|
|[0:03:36]||And there we see there's quite a lot going on, but by default, no messages at all will be visible in the event console or better put no events will be visible in the event console because you need to create a rule for that.|
|[0:03:54]||For this example, I created a rule that catches all the messages and depicts them here. We're not going to dive into that in detail because that's done in a specific video, but this is the way you would handle Windows event messages by default.|
|[0:04:08]||So, now we also want to take a look at how to monitor custom log files because not all applications log to a Windows event log.|
|[0:04:17]||So, let's take a look at that rule. We go to the Setup menu again, we search for log files.|
|[0:04:27]||There we find an agent rule which is called Text logfiles. And if we add that rule, there are several options.|
|[0:04:37]||The bare minimum that we need to do is to configure a log file section and to provide the path to a log file.|
|[0:04:44]||I look something up, I have no idea what's logged in here, but it's a custom log file which is not available in the event console. And that's everything that you need to do to get this started.|
|[0:04:55]||There's a lot of options which you can dive into, but by default, we stick with the settings to be able to just fetch the files.|
|[0:05:03]||And of course, after activating changes, we need to bake agents. And then update the agent on the Windows system.|
|[0:05:20]||So, that's that. And now after we install this updated agent package on the Windows host, it will send the messages from this custom log file to the Checkmk server.|
|[0:05:29]||But there is no change in the services of that host because if we take another look, the rule that we enabled before that forwards all the messages to the event log, to the event console shows up here as this Log Forwarding service.|
|[0:05:44]||And that's really all there is. So, the messages will go through the service, to the event console.|
|[0:05:48]||And as discussed earlier, there you have all the power to filter those events and see whatever you need there.|
|[0:05:56]||So, you saw monitoring event log and custom log files on Windows is quite easy. It's very few rules. It's very simple to implement.|
|[0:06:03]||The really interesting part starts after you fetch those messages because then you have to understand what's going on there and to see, depending on your use case, what you actually want to see in the event console afterwards.|
|[0:06:16]||So, that concludes the video for today. Thank you guys so much for watching. Be sure to subscribe and I will see you around.|
Ep. 1: Installing Checkmk 2.0 and monitoring your first host
In this video, Baris explains how to take get started with Checkmk and start monitoring your first host within a few minutes.
Ep. 2: The Checkmk 2.0 user interface
In this video, Baris take you through the new user interface in Checkmk 2.0. He explains the various components of the User interface such as the new navigation menus, the Sidebar, main dashboard, tactical overview, how to switch between the Checkmk interface themes and much more
Ep. 3: Using SNMP to monitor network devices in Checkmk 2.0
In this episode, Baris explains how to monitor network devices with Checkmk. SNMP is a protocol that many switches, routers, printers, UPSs, hardware sensors and other devices have implemented with the purpose of being able to monitor them easily.
Ep. 4: Monitoring Windows in Checkmk
In this video of our Getting started with Checkmk series, Baris explains how to install a Checkmk agent on a Windows host system and add that into your monitoring environment.
Ep. 5: Using metrics and graphs in Checkmk 2.0
In the 5th episode of the Getting started with Checkmk series, Baris explains using various metrics that you can monitor in Checkmk such as CPU utilization, CPU load etc. You can also see graph visualizations for these metrics or create and customize your own as per your requirements.
Ep. 6: Updating Checkmk 2.0 and using multiple instances
In this video, Baris explains how to update your Checkmk instance. It is very easy and can be done within minutes. You can run multiple Checkmk instances with different versions on the same system. This gives you the flexibility to test the new version before using it in production.
Ep. 7 (part 1): Working with rules and setting thresholds in Checkmk
In the following three-part videos series, Baris explains rule-based monitoring with Checkmk. In the first part, he shows you how you can work with rules and set threshold values. Rule-based configuration is one of the key features for Checkmk which helps you to scale your monitoring easily within minutes.
Ep. 7 (part 2): Smart rules with Host Tags in Checkmk
In the second part of this video, Baris explains using Smart rules with host tags in Checkmk. In the first part, he shows you how you can work with rules and set threshold values. These are features that you can use to build your rules even more intelligently and to better organize your monitoring.
Ep. 7 (part 3): Managing Hosts in Folder in Checkmk
In this final part of our episode on Rule-based monitoring in Checkmk, Baris demonstrates how to manage hosts in folders in Checkmk. This helps you to apply your monitoring configurations at scale and organize your hosts according to your needs.
Ep. 8: Working with Host and Service Groups in Checkmk
In this Baris demonstrates how to create host and service groups in Checkmk, so you can perform actions on an entire group instead of configuring each of them individually.
Ep. 9: Using the Quicksearch function in Checkmk
In this episode of the Checkmk tutorials, Baris shows how you can use the Quicksearch function in Checkmk. You can use it to easily find and manage certain hosts or services. He also explains some examples of filters to you. In Checkmk 2.0 you can use the same syntax in the Seach function found in the monitor menu to get identical results.
Ep. 10: Detecting configuration errors with the Analyze Configuration feature
With the Analyze Configuration feature, you can check if there are any configuration errors in your installation. Checkmk controls a number of possible security risks or potential performance restrictions and indicates if there are any problems.
Ep. 11: View creation and customization in Checkmk
In this video, Baris demonstrates how to customize headers, columns, and more in Views in Checkmk for yourself or other users. He also explains how to create custom views and add desired information to these views.
Ep. 12: Acknowledging problems in Checkmk
In this video, Baris explains how you can acknowledge problems in Checkmk. This function helps you to qualify the states of hosts and services. This allows you to keep track of messages in the main dashboard and, for example, you can add comments to problems.
Ep. 13: Scheduling downtimes in Checkmk
In the episode of our Getting started with Checkmk series, Baris explains how you can manage the maintenance times of your systems in Checkmk. Such scheduled downtimes prevent your monitoring from sending false alarms when a host or service goes to WARN or CRIT during maintenance work. You can also inform the users concerned about the maintenance via Checkmk.
Ep. 14: Distributed monitoring with Checkmk
In this video, Baris explains how you can connect several Checkmk instances to a monitoring system and then manage it.
Ep. 15: MKPs and Plugins in Checkmk
In the 15th episode of our Getting started with Checkmk tutorial series, Baris explains what are Checkmk Extension Packages (MKPs) and how easy it is to integrate them into your Checkmk monitoring environment. MKPs are the preferred format when you make your own extensions as it makes it easy to share with other users or deploy in distributed environments.
Ep. 16: Working with 'Bulk Actions' in Checkmk
In this episode of our Checkmk tutorials series, Baris explains how you can save a lot of time with bulk actions. With this feature you can perform various tasks such as deleting, renaming, service discovery etc. on a large number of hosts simultaneously.
Ep. 17: Working with network topologies in Checkmk
In this video of our gettign startted with Checkmk series, Baris explains how to map network topologies in Checkmk. This feature is quite helpful to manage your network and prevent any unnecessary notifications from the devices in your network.
Ep. 18: Creating and customizing dashboards in Checkmk
In this video of our Getting started with Checkmk series, Mathias explains how you can create and customize dashboards in Checkmk 2.0, so you can get insights into your monitoring according to your requirements. Find out more in this video.
Ep. 19: Monitoring websites and their certificates with Checkmk
In this episode, Bastian demonstrates how to monitor a website and its certificate with Checkmk. You can also monitor specific web pages with Checkmk by using the several options that will suit your use case. Learn more in this video.
Ep. 20: Configuring dashboard elements in Checkmk
Learn how to add data visualization elements of the various metrics into your Checkmk Dashboard. In this video, Mathias explains how you can configure these elements and create a dashboard as per your requirements.
Ep. 21: Setting up notifications in Checkmk
Learn how to set up notifications in Checkmk and assign relevant contacts and contact groups to be notified for various events. Later in this video, our presenter Bastian also demonstrates how you can set up rule-based notifications according to different conditions for hosts and services.
Ep. 22: Monitoring logfiles with Checkmk
Monitor your logfiles with Checkmk using its Logwatch plugin. It is very useful when you want to monitor your logfiles regardless of whether you are using a UNIX/Linux or a windows based system. Learn more in this video.
Ep. 24: 3 Rules for efficient network monitoring
In this video, Bastian demonstrates 3 rules that will help you to efficiently monitor your network interfaces. With Checkmk 2.0, with just three rules, you can set up an efficient network monitoring that will not only monitor all of your network interfaces but also simultaneously provide a detailed overview of all of your ports.
Ep. 25: New UX and security improvements in Checkmk 2.1
Checkmk 2.1 come with many UX improvements such as pre-built dashboards for Linux and Windows, faster core performance and much more. Security features such as two-factor authentication etc. were also added in this new version. Watch this video to learn how to use these new features and enhancements in Checkmk.
Ep. 28: Working with InfluxDB integration in Checkmk
Learn how to send data to InfluxDB from Checkmk. As InfluxDB introduced a new protocol to send data to it, a new connector was developed with Checkmk to talk natively with it. Learn more about it in this video.
Ep. 29: New agent architecture in Checkmk 2.1
With Checkmk 2.1, the agent architecture was modified to enable performance improvements and add new features such as TLS encryption, data compression, and the reversal of direction of communication from the agent. This will enable push mode and pull mode.
Ep. 30: Clustering the Checkmk appliance
In this video, Robin demonstrates how you can cluster your Checkmk appliance to make it resilient against hardware failures. If you are using the Checkmk hardware appliance, it may be helpful to cluster your appliance to maintain high availability.
Ep. 32: Working with the Agent bakery in Checkmk
In this video, Robin demonstrates how to roll out agent packages with the required configuration for different monitored systems using the agent bakery in Checkmk. The "Automatic agent update" is quite a helpful feature as it pulls the latest configurations for an agent automatically and you don't need to manually update all of your agents deployed on different systems.
Ep 33: Monitoring Docker containers with Checkmk
Learn how to monitor Docker containers with Checkmk.In this video, Robin demonstrates the process of setting up a rule to configure the docker plugin and bake an agent with the desired settings for the Docker host.
Ep 34: Introduction to Checkmk Ansible collection
Last year the Checkmk Ansible collection was created to interact with the Checkmk REST API. In this video, Robin demonstrates how you can use this Ansible collection to automate your monitoring with Checkmk.
Ep 35: Monitoring SQL databases with Checkmk
In this video, Robin demonstrates how you can configure your Checkmk site to monitor your SQL databases. As there are many flavours of SQL databases, the process is mostly the same.