Operations | Monitoring | ITSM | DevOps | Cloud

After years of helping developers monitor and debug their production systems, we couldn’t help but notice a pattern across many of them: they roughly know that metrics and traces should help them get the answers they need, but they are unfamiliar with how metrics and traces work, and how they fit into the bigger observability world. This post is an introduction to how we see observability in practice, and a loose roadmap for exploring observability concepts in the posts to come.

In 2017, McAfee found that an average enterprise uses 464 custom applications. A large enterprise — a company with over 50,000 employees — uses 788 custom apps! The more applications you have, the more complex your application environment is. This means that you are more susceptible to outages. So, the tolerance for downtime is impossibly low. Mission-critical applications must be available at all times.

At 8:54 pm on November 1, 2020, a customer of HDFC bank complained on Twitter that the bank’s services like internet banking and ATMs were down. More customers started raising similar issues over the next couple of hours, saying that UPI, credit card, and debit card transactions weren’t working either. Finally, at 11:55 pm, the bank confirmed that one of their data centers faced an outage. “Restoration shouldn’t take long,” they promised.

The cloud is driving enterprise digital transformation. Gartner predicts that by 2026, public cloud spending will exceed 45% of all enterprise IT spending, a 2.5x growth from 2021. Enterprises globally are accelerating application modernization, embracing the cloud. This is giving rise to a few key trends. Software-as-a-Service (SaaS) adoption is on the rise. So, organizations are using applications whose implementation/infrastructure they have little or no control over.

In this article, we will explore why it is imperative to constantly monitor network security metrics, what Aruba Clearpass is, and how it helps us manage network security. Then we will look at what Graphite and Grafana are and how to analyze metrics with their help. Finally, we will learn how MetricFire can make it easier for us to work with Graphite and Grafana.

While more businesses are moving their apps to the cloud, they must also ensure that cloud-based services such as Amazon Web Services (AWS) and other resources remain available. So, how can you make sure these cloud services aren't turned off? You can accomplish this using a tool like Amazon CloudWatch, which monitors applications. What is AWS CloudWatch will be the subject of this article.