Operations | Monitoring | ITSM | DevOps | Cloud

Next Gen Log Management: Maximize Log Value with Telemetry Pipelines

In today's digital-first, cloud-native world, effective log management is crucial. It enhances software quality, operational efficiency, and the customer experience. However, with the rise of distributed and microservices-based architectures, organizations now generate petabytes of log data daily, making analysis and storage increasingly challenging.

Creating Re-Usable Components for Telemetry Pipelines

One challenge for the widespread adoption of telemetry pipelines for SRE teams within an organization is knowing where to start when building a pipeline. Faced with a wide assortment of sources, processors, and destinations, setting up a telemetry pipeline can seem like trying to build a Lego set without any instructions. The solution is to provide teams with pre-defined components that provide specific functionality, that they can then use to build pipelines that meet their own requirements.

Creating In-Stream Alerts for Telemetry Data

Alerts that you receive from your observability tool are based on conditions that existed seconds to minutes in the past, because the alert is only triggered after the data has been indexed within the tool. This means that your ability to take timely action in response to the condition is significantly limited, and often your window of opportunity to react is past by the time you receive the alert.

More Value From Your Logs: Introducing Next Generation Log Management from Mezmo

Once upon a time, we thought “Log everything” was the way to go to ensure we have all the data we needed to identify, troubleshoot, and debug issues. But we soon had new problems: cost, noisiness, and time spent sifting through all that log data. Enter log analysis tools to help refine volumes of log data and differentiate signal from the noise to reduce mental toil to process. Log beast tamed, for now….

More Value From Your Logs: Next Generation Log Management from Mezmo

Once upon a time, we thought “Log everything” was the way to go to ensure we have all the data we needed to identify, troubleshoot, and debug issues. But we soon had new problems: cost, noisiness, and time spent sifting through all that log data. Enter log analysis tools to help refine volumes of log data and differentiate signal from the noise to reduce mental toil to process. Log beast tamed, for now….

A Day in the Life of a Mezmo SRE

What keeps an SRE at the top of his game? I had an insightful conversation with Jon Duarte, a Site Reliability Engineer (SRE) at Mezmo and he walked me through his role and the various tasks he manages on a typical day. Here’s Jon offering a brief glimpse into the challenges he faces, the thought processes behind his approach, and the innovative solutions SREs come up with.

Dogfooding at Mezmo: How we used telemetry pipeline to reduce data volume

Like many other organizations, we at Mezmo struggle with a lot of telemetry data, and for a while our team configured our logs to be sent to a global Mezmo Log Analysis account in our SaaS so we would have a single pane of glass to view all of our logs. Our SRE team wanted to make sure that we have experience utilizing our new pipeline product. We set out some goals before we started using telemetry pipeline.

Applying a Data Engineering Approach to Telemetry Data

The exponential growth of telemetry data presents a significant challenge for organizations, who often overspend on data management without fully capitalizing on its potential value. To unlock the true potential of their telemetry data, organizations must treat it as a valuable enterprise asset, applying rigorous data engineering principles to glean the critical insights and accelerated investigations this data is meant to enable. The telemetry data platform approach democratizes access across disciplines and personas and fosters widespread utilization across the organization.

Unlocking Business Insights with Telemetry Pipelines

Imagine running a large company where data-driven decisions give you a competitive edge. You use a lot of business intelligence tools that tap into vast amounts of data, such as sales figures, inventories, and expenses. This analysis tells you how your company is performing. However, it does not reveal how your "company infrastructure" is performing. This crucial information comes from your systems in the form of telemetry data, such as logs and events.

Why Your Telemetry(Observability) Pipelines Need to be Responsive

At Mezmo, we consider Understand, Optimize, and Respond, the three tenets that help control telemetry data and maximize the value derived from it. We have previously discussed data Understanding and Optimization in depth. This blog discusses the need for responsive pipelines and what it takes to design them.