Operations | Monitoring | ITSM | DevOps | Cloud

January 2024

OpenTelemetry and Grafana Labs: What's new and what's next

A new year is a natural time to reflect on past achievements — and consider future aspirations. When I think about the observability space, specifically, in 2023, OpenTelemetry felt omnipresent. It was a hot topic at every industry event, with at least one dedicated talk at ObservabilityCON, Monitorama, PromCon, and KubeCon + CloudNativeCon, both NA and EU. A notable highlight from KubeCon was OpenTelemetry going GA, marking a significant milestone in the project’s development.

Getting Started with OpenTelemetry Visualization

OpenTelemetry is a Cloud Native Computing Foundation(CNCF) project aimed at standardizing the way we instrument applications for generating telemetry data(logs, metrics, and traces). However, OpenTelemetry does not provide storage and visualization for the collected telemetry data. For OpenTelemetry visualization, you need to use a backend that can ingest the collected data and provide a web UI to visualize it.

OpenTelemetry vs Prometheus Detailed Comparison

Both OpenTelemetry and Prometheus are open-source projects under the Cloud Native Computing Foundation. OpenTelemetry is a more comprehensive observability framework with support for metrics, traces, and logs. In contrast, Prometheus is focused specifically on time-series metrics. OpenTelemetry is more versatile, and if you’re confused between choosing between the two, go for OpenTelemetry. We will delve deeper into the reason for choosing OpenTelemetry over Prometheus in this article.

Observability with OpenTelemetry and Checkly

Observability isn't just a buzzword; it's a vital compass guiding us through the maze of system health and performance. As we’ve adopted microservice architectures, the ability to know ‘what is currently happening in our system’ has diminished as our operational resilience has increased. We find services scattered among a maze of interconnections and interdependencies. And even the logs that used to guide are now scattered throughout this maze.

RabbitMQ monitoring with OpenTelemetry

More about SigNoz: SigNoz - Monitor your applications and troubleshoot problems in your deployed applications, an open-source alternative to DataDog, New Relic, etc. Backed by Y Combinator. SigNoz helps developers monitor applications and troubleshoot problems in their deployed applications. SigNoz uses distributed tracing to gain visibility into your software stack. If you need any clarification or find something missing, feel free to raise a GitHub issue with the label documentation or reach out to us at the community slack channel.

Monitoring your Spring Boot Application using OpenTelemetry

OpenTelemetry can auto-instrument your Java Spring Boot application to capture telemetry data from a number of popular libraries and frameworks that your application might be using. It can be used to collect logs, metrics, and traces from your Spring Boot application. In this tutorial, we will integrate OpenTelemetry with a Spring Boot application for traces and logs. OpenTelemetry is a vendor-agnostic instrumentation library that is used to generate telemetry data like logs, metrics, and traces.

Understanding Flame Graphs for Visualizing Distributed Tracing

In the ever-evolving world of software development, one constant remains - the pursuit of better performance. As applications grow in complexity and demand, the need for tools to uncover performance bottlenecks becomes paramount. Flamegraphs, a brainchild of Brendan Gregg, has emerged as an important visualization of insight, showing those dark corners of your codebase that need optimization.

OpenTelemetry Collector - architecture and configuration guide

OpenTelemetry Collector is a stand-alone service provided by OpenTelemetry. It can be used as a telemetry-processing system with a lot of flexible configurations to collect and manage telemetry data. Let's do a deep dive on OpenTelemetry Collectors to understand how it works. The first step in setting up observability with OpenTelemetry is instrumentation. The application code is instrumented with OpenTelemetry client libraries that help generate telemetry data like logs, metrics, and traces.

Accelerate TraceQL queries at scale with dedicated attribute columns in Grafana Tempo

With Grafana Tempo 2.3, we introduced a new storage format (vParquet3), which enabled an exciting new feature (dedicated attribute columns) that focused on the read path. Dedicated attribute columns offer a wide range of benefits primarily centered around query performance and memory usage. These columns can improve read speed across most queries, and they can have a major impact on resource utilization.

OTel Applications on Retrace

We are excited to inform you that Open Telemetry is now available for you with the introduction of “Netreo OTel Appliance”. With the OTel Appliance, cloud-native services like AWS Lambda, AWS ECS, AWS EKS, Azure Functions, Azure App Services, Azure Container Instances, and Azure Kubernetes Services can be monitored and you see application traces and logs in Retrace UI (s1.stackify.com). The applications hosted in the cloud Serverless and containers can be monitored without running the Retrace agent within the instance itself.

Decoding PostgreSQL Monitoring | 101 Guide

Monitoring PostgreSQL for performance issues is critical. PostgreSQL is a powerful open-source relational database system that stands out for its robustness, scalability, and strong emphasis on extensibility and standards compliance. In this guide on PostgreSQL monitoring, we will cover key PostgreSQL metrics that should be monitored, best practices for monitoring PostgreSQL and some tools with which you can set up PostgreSQL monitoring.

A Basic Introduction to OpenTelemetry Python

Think of a tool that simplifies application monitoring and helps developers and staff trace, collect logs and measure performance metrics. That is what OpenTelemetry Python provides. OpenTelemetry (OTel) Python acts as a guiding light, offering insights into the behaviors and interactions of complex, distributed systems and enabling a deeper understanding of performance bottlenecks and system dependencies. The significance of OTel lies in its pivotal role in modern software development.

What are Cloudwatch Metrics? How to implement Custom Metrics in Cloudwatch?

CloudWatch metrics play a critical role in monitoring AWS resources and facilitating effective troubleshooting during system failures. It allows for continuous monitoring of AWS resources like EC2 instances, Lambda functions, and RDS databases. Using Cloudwatch metrics, DevOps teams can monitor and manage their AWS infrastructure easily. Amazon CloudWatch is a comprehensive monitoring and observability service provided by Amazon Web Services (AWS).

OpenTelemetry VS Prometheus: The Essential Guide

OpenTelemetry vs Prometheus is a commonly searched and debated topic in the Observability and monitoring space. While both platforms are widely used in software and infrastructure management today, most people don’t understand the difference between the two. Both platforms stand as robust tools in the realm of observability, each offering unique capabilities. OpenTelemetry offers a uniform approach for gathering, instrumenting, and exporting telemetry data.

11 Top MongoDB Monitoring Tools; Free & Open-Source [2024]

Are you looking for MongoDB monitoring tools? Then you’re at the right place. MongoDB is one of the most popular and powerful NoSQL databases out there. The fact that it’s a document-based database makes it blazing fast. With all the features that MongoDB comes with, you need to keep an eye on your MongoDB's health and performance - especially as it directly deals with your data. There are many monitoring tools out there, and choosing the right one can be confusing.

What is Cloudwatch Metrics? Detailed 101 Guide

CloudWatch metrics play a critical role in monitoring AWS resources and facilitating effective troubleshooting during system failures. It allows for continuous monitoring of AWS resources like EC2 instances, Lambda functions, and RDS databases. Using Cloudwatch metrics, DevOps teams can monitor and manage their AWS infrastructure easily. Amazon CloudWatch is a comprehensive monitoring and observability service provided by Amazon Web Services (AWS).

Monitoring Docker Containers Using OpenTelemetry [Full Tutorial]

Monitoring Docker container metrics is essential for understanding the performance and health of your containers. OpenTelemetry collector can collect Docker container metrics and send it to a backend of your choice. In this tutorial, you will install an OpenTelemetry Collector to collect Docker container metrics and send it to SigNoz, an OpenTelemetry-native APM for monitoring and visualization.

Monitoring CouchDB with OpenTelemetry and SigNoz

OpenTelemetry can help you monitor CouchDB performance metrics with the help of OpenTelemetry Collector. In this tutorial, you will install OpenTelemetry Collector to collect CouchDB metrics and then send the collected data to SigNoz for monitoring and visualization. Before that, let’s have a brief overview of CouchDB. If you want to jump straight into implementation, start with this Prerequisites section.

Cisco Secure Application: Fulfilling the APM + ASM promise for OpenTelemetry

Cisco AppDynamics is making big strides in enabling both application performance and security monitoring for OpenTelemetry. Learn what we’ve done so far. When DevOps began taking hold around 2007, it was meant as a mechanism to remove silos between IT teams and accelerate software development.

Building a Secure OpenTelemetry Collector

The OpenTelemetry Collector is a core part of telemetry pipelines, which makes it one of the parts of your infrastructure that must be as secure as possible. The general advice from the OpenTelemetry teams is to build a custom Collector executable instead of using the supplied ones when you’re using it in a production scenario. However, that isn’t an easy task, and that prompted me to build something.

Log Monitoring 101 Detailed Guide [Included 10 Tips]

Log monitoring is the practice of tracking and analyzing logs generated by software applications, systems, and infrastructure components. These logs are records of events, actions, and errors that occur within a system. Log monitoring helps ensure the health, performance, and security of applications and infrastructure. Log Monitoring helps in early detection of potential issues, ensuring systems run smoothly and efficiently. In this detailed 101 guide on Log monitoring, we will learn.

OpenTelemetry in 2023 - What we learnt from the community and our users

OpenTelemetry has brought a sea change in the world of observability. The idea of the project was to standardize the instrumentation needed for generating telemetry. Teams shouldn’t need to change how they collect data if they want to try a new visualization/backend for the telemetry data. That was the vision. This idea seems to have resonated with the developer and devops communities.

The Importance of Traces for Modern APM [Part 2]

In part 1, we looked at how the design plan of traditional monitoring technologies depended heavily on properties of the systems that were intended to monitor and then showed how those properties began to be undermined by an increase in complexity, an increase which can ultimately be captured by the concept of entropy. In this part, we will explore how increased entropy forces us to rethink what is required for monitoring.

LLM Observability with OpenTelemetry and SigNoz

In the rapidly evolving world of Large Language Models (LLMs), ensuring peak performance and reliability is more critical than ever. This is where the concept of 'LLM Observability' comes into play. It's not just about monitoring outputs; it's about gaining deep insights into the internal workings of these complex systems.

Implementing OTEL for Kubernetes Monitoring

Kubernetes is a top container orchestration platform. The Kubernetes clusters manage everything much from collecting to storing vast magnitudes of data from your multiple applications. It is this very property that can sometimes boom into an unending data pile later on. Imagine a large warehouse of apparel, it has every size of clothing for men, women, and children. Now if you are asked to pick out one particular type from it within a small time frame, I know you will totally dread it.

Improved Dashboard Performance, Better Trace View UX & New Logs Processors - SigNal 32

Welcome to the last SigNal of 2023! 12 months of building and shipping things to make open-source observability available to teams of all sizes. What a great journey it has been for Team SigNoz in the year 2023. We crossed some great milestones - raised $6.5MN to supercharge our growth, more than 15,000 Github stars, and 8.6 million Docker downloads. And the best part of our journey has been building with our community.

With OpenTelemetry, ComplyAdvantage overhauled its observability (twice)

ComplyAdvantage, which provides compliance and risk management tools, has overhauled its observability platform twice in two years, first moving from on-prem Grafana OSS to Datadog, and then migrating from Datadog to Grafana Cloud. Join Principal SRE Adam Wilson to hear how his team’s approach to observability evolved, and how their increased OTel usage made it possible to migrate twice — and to get the most out of Grafana Cloud for metrics, logs, traces, Kubernetes monitoring, and more.

Top 6 Distributed Tracing Tools in 2024

Distributed tracing is the functionality to trace requests or messages flowing through different systems or environments like frontend, Backend, middleware. Distributed tracing brings connectivity or visibility of various services using a unique identifier. This identifier is passed to different services to correlate them as a single flow. We track data from different services with distributed tracing, but how do we visualize them? Visualization is a tedious task.

An Introduction to OpenTelemetry JavaScript

Monitoring and observing application performance is a cornerstone for maintaining robust and efficient systems in the ever-evolving development landscape. One key player in this domain is OpenTelemetry. This post provides a comprehensive tutorial and unpacks what OpenTelemetry is, its applications and integration into the JavaScript ecosystem.

How to export Azure Monitor Metrics using OpenTelemetry to SigNoz

Using OpenTelemetry Collector, you can collect metrics from Azure monitor and export them to any backend of your choice. Azure Monitor is a powerful service within the Microsoft Azure ecosystem that provides extensive metrics and logging capabilities. Yet the siloed nature of data in such tools can obscure the bigger picture, hindering a holistic view of system health. In this tutorial, we cover: If you want to jump straight into implementation, start with this Prerequisites section.