Containerized Airflow → Postgres ETL Pipeline

Stack: Apache Airflow · Docker Compose · Python · PostgreSQL

A containerized ETL pipeline I engineered for my Data Engineering course at Radford University (Fall 2024). Airflow orchestrates the extract, transform, and load steps: it processes and merges datasets from Kaggle and stores the results in Postgres, all running in Docker Compose. The video walks through the design decisions behind it.