Operations | Monitoring | ITSM | DevOps | Cloud

Connecting the data across your business and getting it where it needs to be can often be challenging and place undue operational stress across your application, infrastructure, and platform teams. Apache Kafka, and in particular the Apache Kafka Connect framework simplifies these pain points by allowing you to use Kafka to transport data from where it is produced, to where it needs to be stored, analyzed, or transformed.

Aiven for ClickHouse has become a favorite on the platform thanks to its blazing-fast analytical querying, built specifically to handle the unique challenges of OLAP workloads. It excels at crunching massive datasets in real-time, making it a favorite for demanding applications like log analytics, web analytics, and ad tech. At Aiven, we understand the power that ClickHouse can unlock for businesses of any size.

Tiered Storage for Apache Kafka is a simple idea that goes a longway. At its bare bones, it basically means: store most of the Kafka broker’s data in another server, e.g AWS S3. On the surface, it sounds insignificant—like a minor architectural tweak with minimal impact.

Money makes the world go around and this has never been more true when it comes to the data economy as innovative start-ups seek investment to achieve their ambitions and unlock their potential. Led by insight from Atomico and Realm, this piece - the fifth in our data economy series - will look at the data economy from an investment perspective - what traits do they look for in data-driven companies? How are start-ups approaching it? These are the questions this piece will answer.

The data economy may hinge on technology but it is being driven-forward by people. The fourth piece in our series explores this side of the data economy in detail looking at the evolution of digital skills required in today’s market. Featuring insight from Dojo, Atomico and WorkOrb, it looks at the challenges of finding people with the necessary skills and touches on what is required from a human capital perspective for companies to best achieve success in the data economy.

The third article in our Data Economy series examines what it takes to unlock the opportunities with AI. Based on some of the key findings of our own research ‘Predicting the Data and AI Revolution’ and exclusive insights provided by leaders in the data economy, this piece explores how organizations are currently using AI.