How to Scale Observability with Grafana, Tempo, Loki, and Prometheus | Dojo | Grafana

How to Scale Observability with Grafana, Tempo, Loki, and Prometheus | Dojo | Grafana

Jun 8, 2024

In this talk, Roberto, a staff engineer at Dojo, outlines the company's journey toward achieving advanced observability, which has been crucial for their reliability efforts over the past three years.

Dojo, a payments provider in the UK, has focused on evolving their observability practices, initially starting with basic monitoring and progressing towards comprehensive observability, encompassing metrics, traces, and logs.

Roberto discusses the early challenges faced, such as lack of metrics and alert fatigue, and how the team overcame these by standardizing instrumentation and promoting a culture of ownership and accountability.

By adopting tools like Grafana, Prometheus, Tempo, and Loki, Dojo was able to integrate and correlate metrics, traces, and logs, significantly enhancing their troubleshooting capabilities. The introduction of global alerts and templated alerting systems further streamlined observability, making it accessible and efficient for engineering teams. Roberto highlights the impressive scalability achieved, with over 400 instrumented workloads and 200 active users, and concludes with future plans to incorporate profiling with tools like Pyroscope and leverage observability data for cost management.

Helpful links:
☁️ Grafana Cloud is the easiest way to get started with Grafana dashboards, metrics, logs, and traces. Our forever-free tier includes access to 10k metrics, 50GB logs, 50GB traces and more. We also have plans for every use case. Sign up: https://grafana.com/get/

❓ Have a question that isn't related to this video? Check out the Official Grafana Community Forums and ask your question or find your answer: https://community.grafana.com/

👍 If you found this video useful, be sure to give it a thumbs up and subscribe to our channel for more helpful Grafana videos.

📱 Follow us for the latest and greatest on all things Grafana and our other OSS projects.

X: https://twitter.com/grafana
LinkedIn: https://www.linkedin.com/company/grafana-labs/mycompany
Facebook: https://www.facebook.com/grafana

#Grafana #Observability #Dojo #Prometheus