Operations | Monitoring | ITSM | DevOps | Cloud

Load Testing Kafka #speedscale #kafka #loadtesting

Message brokers are a critical component of modern distributed systems, facilitating asynchronous communication between services. Load testing message broker integrations requires special considerations since the interaction patterns differ from traditional HTTP-based APIs. Speedscale provides specialized tooling to help you load test applications that integrate with message brokers by.

The Ultimate Guide to Kafka Monitoring Best Practices, Metrics, and Tools

If you’re operating modern, data-driven applications—which, let’s face it, you likely are—Kafka serves as the central streaming platform, delivering data in real-time. It’s impressive, extremely fast, and exceptionally powerful for achieving high throughput and scalability. But here’s the catch: with significant power comes the need for vigilant oversight. Neglecting your Kafka environment is like driving a racecar with your eyes closed. It’s bound to end badly.

Benchmarking Diskless Topics: Part 1

We benchmarked Diskless Kafka (KIP-1150) with 1 GiB/s in, 3 GiB/s out workload across three AZs. The cluster ran on just six m8g.4xlarge machines, sitting at <30% CPU, delivering ~1.6 seconds P99 end-to-end latency - all while cutting infra spend from ≈$3.32 M a year to under $288k a year. That’s a >94% cloud cost reduction. Extending Apache Kafka does come with an explicit tax.

Get Kafka-Nated Episode 3

Join us for Episode 3 of Get Kafka-Nated, where host Hugh Evans sits down with Greg Harris, Staff Software Engineer and the driving force behind KIP-1150, to explore the future of cloud-native Apache Kafka. In this episode, we dive into diskless Kafka — a bold reimagining of Kafka’s architecture that moves data from broker disks to object storage. Greg explains the technical challenges, the operational benefits, and the broader implications for Kafka users.