Operations | Monitoring | ITSM | DevOps | Cloud

Get an introduction to Apache Kafka® Tiered Storage which enables more effective data management by utilizing two different storage types—local disk and remote cloud storage solutions such as Amazon S3, Google Cloud Storage, and Azure Blob Storage. This feature offers a tailored approach to data storage, allowing you to allocate frequently accessed data to high-speed local disks while offloading less critical or infrequently accessed data to more cost-effective remote storage solutions. Tiered storage enables you to indefinitely store data on specific topics without running out of space. Once enabled, it is configured per topic, giving you granular control over data storage needs.

Change Data Capture (CDC) is the process of tracking the changes happening in one or more database table in a source system and propagating them to a target technology. The objective of this video is to create a CDC flow from a source table in a MySQL database to Apache Kafka® via the Kafka Connect Debezium Source connector. Check out these resources to learn more.

Introducing Elastic Agent's new feature: native output to Kafka. With this latest addition, Elastic’s users can now effortlessly route their data to Kafka clusters, unlocking unparalleled scalability and flexibility in data streaming and processing. In this video, we'll guide you through a step-by-step configuration with Fleet and Confluent Cloud.

Welcome to the first episode of our brand new series, "Canonical Data," where we dive deep into the world of data with Canonical. In this episode, we shine a spotlight on Charmed Spark and Charmed Kafka, Canonical's solutions for harnessing the power of Apache Spark and Apache Kafka on Kubernetes, with support, CVE patching, and security updates for 10 years through Ubuntu Pro.

Discover the future of content recommendation systems with Marc Oppenheimer, Senior Data Engineer at Canonical. In this informative video presentation, you'll gain profound insights into designing a sophisticated, real-time personalization architecture using the power of Apache Kafka and Spark. This video is your gateway to mastering the technical intricacies of data engineering and AI-driven content recommendation.

As a company, Datadog ingests trillions of data points per day. Kafka is the messaging persistence layer underlying many of our high-traffic services. Consequently, our Kafka usage is quite high: double-digit gigabytes per second bandwidth and the need for petabytes of high performance storage, even for relatively short retention windows.