Operations | Monitoring | ITSM | DevOps | Cloud

Kafka Tiered Storage in depth: How Reads and Deletes Flow (Prefetching, Caching)

In this article, we will be continuing our series of deep dives into KIP-405. Previously, we covered: Now, we turn our attention to the internals of the read and delete paths. Just like we did for the write and metadata, here we will also be focusing on Aiven’s battle-tested Apache-licensed KIP-405 plugin. What makes the read path particularly interesting is how it delivers latency comparable to local disk or memory systems despite leveraging external object storage—let's dive in!

PostgreSQL vs. AlloyDB Omni: understanding the differences

With the introduction of Aiven for AlloyDB Omni, many of our customers have wondered what the difference is between AlloyDB Omni and its architectural source project, open source PostgreSQL. AlloyDB Omni is more than just a re-implementation of PostgreSQL, and understanding how it is similar – and how it differs – from open source PostgreSQL is a valuable exercise.

The Hitchhiker's guide to Diskless Kafka

KIP-1150 isn’t a distant, strange planet; it just reroutes Kafka’s entire replication pathway from broker disks to cloud object storage. Flip one topic flag and your data bypasses local drives altogether: Because Diskless is built into Kafka (no client changes, no forks), we had to solve a 4D puzzle: How do you make a Diskless topic behave exactly like a Kafka one—inside the same cluster—without rewriting Kafka?

Aiven for PostgreSQL Performance Benchmarks Across Cloud Offerings

Aiven offers a seamless multi-service cross-cloud experience. When optimizing your infrastructure performance, understanding how services performance can change across clouds can help differentiate your business. This blog details the benchmarking of how PostgreSQL performs on each of our cloud offerings: AWS, GCP, OCI, and Azure.

Maximizing Innovation: Cloud Cost Optimization Strategies

In today’s world, cloud technologies are essential for keeping up with the accelerating pace of business and changing market dynamics. However, innovation cannot be funded by a blank check; cloud cost optimization is essential to finding efficiency while innovating. Hear from Aiven about the principles of optimizing managed databases and streaming services and techniques for bringing cloud costs down while using third-party vendors.

Apache Kafka Tiered Storage in Depth: How Writes and Metadata Flow

The idea behind KIP-405 is to simply store most of the cluster’s data in another service. As we covered in detail in the last article - it’s a simple-sounding idea that goes a very long way. This other server where the data gets stored is pluggable. KIP-405 was designed in such a way to make Kafka seamlessly extensible to store its data in any kind of external store through a solid interface.