Robin Moffatt • 3/20/2025

Building a data pipeline with DuckDB

This technical article details the process of constructing a data pipeline with DuckDB. It uses real-time UK flood and river level data from a public API, demonstrating data ingestion via HTTPFS, transformation into fact and dimension tables (including SCD Type 1 logic), and preparation for analytics with tools like Rill Data and Metabase.

0 comments

#Etl #Data Engineering #Data Pipeline