Monitoring Kafka performance metrics

Kafka is a distributed, partitioned, replicated, log service developed by LinkedIn and open sourced in 2011. Basically it is a massively scalable pub/sub message queue architected as a distributed transaction log. It was created to provide “a unified platform for handling all the real-time data feeds a large company might have”.Kafka is used by many organizations, including LinkedIn, Pinterest, Twitter, and Datadog. The latest release is version 2.4.1.


Collecting Kafka performance metrics

If you’ve already read our guide to key Kafka performance metrics, you’ve seen that Kafka provides a vast array of metrics on performance and resource utilization, which are available in a number of different ways. You’ve also seen that no Kafka performance monitoring solution is complete without also monitoring ZooKeeper. This post covers some different options for collecting Kafka and ZooKeeper metrics, depending on your needs.


Monitoring Kafka with Datadog

Kafka deployments often rely on additional software packages not included in the Kafka codebase itself—in particular, Apache ZooKeeper. A comprehensive monitoring implementation includes all the layers of your deployment so you have visibility into your Kafka cluster and your ZooKeeper ensemble, as well as your producer and consumer applications and the hosts that run them all.


Monitor Jenkins jobs with Datadog

Jenkins is an open source, Java-based continuous integration server that helps organizations build, test, and deploy projects automatically. Jenkins is widely used, having been adopted by organizations like GitHub, Etsy, LinkedIn, and Datadog. You can set up Jenkins to test and deploy your software projects every time you commit changes, to trigger new builds upon successful completion of other builds, and to run jobs on a regular schedule.


The Top 5 Kubernetes Metrics You Need to Monitor

In this article, we’ll help you understand the key metrics and components to monitor in a Kubernetes environment as well as explain two open-source solutions to effectively monitor your Kubernetes cluster: Prometheus and Grafana. Kubernetes is an open-source container management platform that helps you run containers at scale.


10 Best DevOps Certifications in 2020 Ranked

Certifications are a great way to show industry knowledge of specific tools but also display your commitment and passion for the subject. Many big tech players such as Google, Amazon Web Services (AWS), and Microsoft offer certifications to educate users on how to use their tools and services correctly. Besides sharing valuable knowledge, DevOps certification is a great way to onboard new developers and businesses to their platform. But why should you participate in exams to receive certifications?


Block Security Vulnerabilities from Entering Your Code

As continuous software deployments grow and become the accepted standard, security measures gain even more importance. From development and all the way through to production, security requirements should be adopted by all teams in an organization. JFrog IDE integrations provide security and compliance intelligence to the developer right from within their IDE.

Virtual Meetup: Running Elasticsearch on Kubernetes

Elasticsearch is the world's most popular open source search engine. Kubernetes (k8s) is the popular container orchestration engine giving developers the flexibility to run all sorts of workloads easily. Elastic launched Elasticsearch k8s operator sometime ago. With this, one can not only run Elasticsearch on k8s but also can launch other Elastic Stack projects like APM Server, help run rolling upgrades, manage data etc. This talk is a demo of all latest features.