Log Management for your Homelab with Fluentd and Aiven for PostgreSQL

Tired of not knowing why your home lab containers are crashing? In this video, we’ll walk through how to set up a consolidated logging pipeline using Aiven for PostgreSQL (with TimescaleDB), Fluentd and Grafana — all running on my upgraded Mac Mini home lab. The key insight: never keep your troubleshooting tools on the same machine that's giving you problems!

I cover how to build a custom Fluentd Docker image with the PostgreSQL plugin, wire up Docker Compose so every container ships its logs to Fluentd, store time-series logs efficiently in Aiven for PostgreSQL using TimescaleDB compression and visualize everything in Grafana dashboards. Plus, we’ll see how to use Aiven's built-in AI editor to query logs without writing SQL from scratch.

Timestamps:

0:00 — Intro & the home lab problem

0:51 — Why Aiven for PostgreSQL (not self-hosted)

2:00 — Fluentd overview & plugin options

3:06 — Building the Fluentd Docker image

4:50 — Setting up Aiven for PostgreSQL (create service walkthrough)

5:48 — Reviewing logs & metrics in Aiven console

6:39 — Using Aiven's AI editor to query logs

9:24 — Connecting individual containers to Fluentd (Docker network)

11:05 — Grafana dashboard for container logs

12:40 — Wrap-up & what's next

Useful Links:

• Aiven for PostgreSQL → https://aiven.io/postgresql
• Aiven Free Trial → https://console.aiven.io/signup
• Fluent Plugin for SQL (PostgreSQL) → https://github.com/tagomoris/fluent-plugin-sql

#homelab #postgresql #fluentd #grafana #docker #selfhosted #timescaledb