Operations | Monitoring | ITSM | DevOps | Cloud

The latest News and Information on Incident Management, On-Call, Incident Response and related technologies.

Home Call Survival Guide

Whether it’s your first or hundredth home call shift, preparing yourself both physically and mentally is crucial. These shifts can be unpredictable, demanding, and emotionally taxing, making it essential to prioritize your well being while maintaining your readiness to provide the best possible patient care. By adopting effective time management, organization, and healthy strategies, you can confidently navigate the unique challenges of home call shifts. Key Takeaways (TL;DR)

What is MTTR and How Does It Impact Your Bottom Line?

Mean time to repair (MTTR), sometimes referred to as mean time to resolution, is a popular DevOps and site reliability engineering (SRE) team metric. MTTR identifies the overall availability and disaster recovery aspects of your IT assets or application workloads. The acronym MTTR can cause some confusion since it has different meanings across different industries. Sometimes, MTTR refers to mean time to respond: the amount of time needed to react to a problem.

Update December 2024 - Intelligent event filters and enhanced manual alarm distribution

In our December update, we have significantly revamped and improved manual alerting. If you need to carefully evaluate incidents before distributing them manually to the respective teams or want to send critical operational updates to relevant personnel, you’ll love the new features we’ve introduced! Additionally, we’ve added intelligent filtering options for automatically incoming events.

Reducing noise: configuring alert processing with Terraform

With increasing numbers of alerts, keeping focus on the important and most critical alerts proves to be more and more of a challenge. A reduction of alert noise, meaning the prevention of too many created alerts and any kind of user notifications, is needed to ensure efficient alert response. While a detailed explanation of this topic is given in this blog post, a flexible and automated setup for your relevant resources can be achieved with Terraform using the ilert Terraform provider.

Incident Management for Software Engineers: Lessons from Production Fires

A notification "Critical: Payment processing down" is every software engineer's nightmare - a production incident that demands immediate attention. But the truth is that production incidents are inevitable. The question isn't whether they'll happen, but how well you'll respond when they do. In this article I explore the lessons I learned from real-world production fires.

Incident Management vs Incident Response: What You Must Know

In the dynamic world of IT operations and software development, downtime or service disruptions can be costly. As businesses rely more on digital infrastructure, managing and responding to incidents effectively is no longer optional—it’s a critical necessity. However, many organizations struggle to differentiate between incident response and incident management, often using the terms interchangeably.

Transforming ITSM with AIOps: EMA research

Managing modern IT environments is becoming more complex and fragmented as organizations rely on a broader range of applications and services, including cloud, hybrid infrastructure, microservices, and legacy systems. This complexity and velocity surpass human capacity and old processes, making it challenging for IT teams to respond efficiently to incidents.

Improve IT incident management with BigPanda AIOps

The handoff between IT operations (ITOps) and incident management is often chaotic. NOC operators receive an overwhelming deluge of noisy low-priority alerts, which prevents them from detecting actionable, important alerts. This delay causes tickets to pile up, SLAs breached, and unnecessary assignments and escalations to L2 and L3 engineers. Concurrently, L1 analysts react to user-initiated tickets with little to zero context, forcing them to escalate the issues.

Welcome to Your New Retrospective Experience: More Customizable, Collaborative, and Powerful Than Ever

At FireHydrant, we believe that what happens after incidents is just as important as what happens during – and that’s why Retrospectives have always been a cornerstone of our product. Today, we’re proud to introduce the most powerful, customizable, and collaborative retrospective experience you’ll find anywhere.