Operations | Monitoring | ITSM | DevOps | Cloud

Grab your cup and prepare to Get Kafka-Nated! In this series, we’ll be digging into everything Apache Kafka, from the pre-history of Kafka to the latest Kafka Improvement Proposal (KIP). We’ll be joined by a range of guests who have been at the forefront of Kafka for many years.

Datadog Data Observability provides a complete solution with quality checks (e.g., volume, row changes, freshness), custom SQL-based monitors, anomaly detection, column-level lineage across systems like Snowflake and Tableau, full pipeline visibility, and targeted alerts when data issues arise.

Learn how to stream data from Kafka into ClickHouse using Aiven’s integration wizard. In this demo, we show you how to generate sample logistics data in Kafka, configure the integration to map Avro-formatted fields, and connect to ClickHouse to view and query the ingested data. We also demonstrate how to create a materialised view in ClickHouse to store and query streamed data efficiently, making real-time analytics fast and easy.

Customers asked for a simpler way to store and access telemetry data, and Cribl delivered. First came Cribl Lake. Cost effective data storage, flexible access, and identity based authorization instead of infrastructure based access rules. A simple way to retain data at rest and run slow, inexpensive analytics when needed. But the story did not end there.

Learn how to quickly create a fork of your Aiven for PostgreSQL instance to set up a safe staging or testing environment. In this demo, we walk you through selecting your project and service, navigating to the backups & forking section, naming your new instance, choosing the cloud provider and plan, and finalising the fork to replicate your original database. This approach allows you to test changes safely without affecting your production database, making development and QA workflows much more reliable.