Operations | Monitoring | ITSM | DevOps | Cloud

The latest News and Information on Log Management, Log Analytics and related technologies.

From stateful to stateless: Sumo Logic's transition from Lucene to Parquet-based architecture

Ensuring scalability, performance, and cost-effectiveness is a constant challenge for cloud-native log management and observability. At Sumo Logic, we faced this challenge head-on by transitioning from a stateful, Lucene-based architecture to a completely stateless, Parquet-based architecture. This transformation lets us improve data storage efficiency, streamline operational complexity, and meet the demands of an ever-increasing data scale.

Threat Hunting with Cribl Search

Imagine you’re the protector of a castle. Your walls are tall, the gates are strong, and the guards are well-trained. But what if an intruder was still able to slip past your defenses? Even with the best security tools, not every threat will be caught. Threat hunting is the proactive approach to finding attackers that might have bypassed your defenses.

The Path to Autonomous Observability

Autonomous observability for system monitoring and management aims to use GenAI and machine learning to automatically detect, diagnose and resolve issues. In conversations about cloud observability today, discussions often shift from “what’s possible” to “what’s practical.” Too often, these conversations highlight the shortcomings of current observability processes, tools and financial models.

Enhancing Log Analysis with Machine Learning (ML)

Log Analysis has been a beneficial practice for organizations for numerous years, and over these years it has continuously evolved. This has been in part driven by the increasing volume of logs that companies are required to monitor. Now, log analysis is shifting again, incorporating machine learning (ML) and artificial intelligence (AI) to assist data analysts in identifying system log patterns and anomalies.

October '24 BindPlane Update

I'm covering our powerful new feature: the coalesce processor in BindPlane! I’ll walk you through how to use it to simplify your telemetry data by merging mismatched field names—like user and username—into one unified field (usr). We’ll configure a BindPlane Gateway, capture telemetry from various sources, and route it all to Honeycomb and S3. With the coalesce processor, field names get standardized quickly, making your dashboards and alerts far more intuitive.

Encoding HAProxy logs in machine-readable JSON or CBOR

Standardized logging formats are important for teams that rely on logging for observability, troubleshooting, and workflow integration. Using structured formats simplifies parsing and eliminates the need to interpret fields manually, ensuring consistency across logging formats. This reduces manual work, prevents brittleness from unstructured logs, and simplifies integration between teams that feed logs into a shared aggregation system.

Scaling Culture on Purpose: How Cribl is Building for the Future After Our Series E

Cribl’s recent $319M Series E round marks a significant milestone in our journey to becoming a generational company. While this growth opens the door to new opportunities for our company, it also presents a challenge: how do we ensure our amazing culture scales alongside the business? At Cribl, we believe in Culture on Purpose—an intentional, values-led approach to evolving our culture as we grow.

Reduce Observability Costs with OpenTelemetry Setup

Maintaining and visualizing telemetry data efficiently is super important for DevOps and SecOps teams. OpenTelemetry, a fantastic open-source observability framework, can really help with this without being too costly. Picture having a simple process that improves your data and helps your team make smart decisions without spending too much money. Let's chat about some budget-friendly ways to set up OpenTelemetry agents.

State of Observability 2024 Reveals How Leaders Outpace Their Peers

In 2024, simply having an observability practice is a given. In this era of observability, a high-functioning team will set leaders apart from their peers. Leading observability practitioners don’t fix issues by putting hundreds of people into a virtual room, or frantically messaging in a temporary Slack channel to find root causes. Because leaders embed observability into their development practices early, a feature launch is a quiet non-event.