How Datadog Manages 50,000 Apache Iceberg Tables at Scale

Think managing a few database tables is hard? Try 50,000 production Iceberg tables storing petabytes of data with 8 million scans per day. In this clip, Datadog's platform team reveals the architecture choices behind their managed Iceberg implementation that serves hundreds of internal engineering teams.

Discover the 3 critical requirements for running Iceberg at this scale: multi-engine support (Spark, Trino, Ray), multi-cloud capability across AWS/Azure/GCP, and guaranteed isolation in multi-tenant environments. Whether you're building a data platform or just curious about enterprise-scale data infrastructure, this is a masterclass in operational data management.

Subscribe for more insights from companies running data infrastructure at massive scale.