Explores using Lance and Iceberg formats for multimodal AI data, addressing scan-heavy analytics vs. random-access retrieval for ML training.
Explores integrating MLflow 3 with data pipelines for unified observability, covering data lineage, drift detection, and CI/CD for ML.
Explores modern feature stores beyond batch pipelines, covering streaming features, two-store models, and real-time ML inference.
Explains how OpenLineage provides a standardized API for data lineage, enabling faster incident investigation and data observability across the stack.
Compares Apache Paimon and Iceberg for handling mutable streams, focusing on Paimon's LSM-tree architecture for high-frequency updates.
Explores policy-as-code for lakehouse governance using ABAC, OPA, and cloud-native tools to replace RBAC with scalable, query-time data access controls.
A technical guide on building real-time lakehouse architectures using Apache Flink 2.1 and the Dynamic Iceberg Sink, addressing schema drift, file proliferation, and operational rigidity.
Explores modern single-node data engineering tools like DuckDB, DataFusion, Polars, and LakeSail built on Apache Arrow for high-performance analytics.
Explains how semantic layers improve enterprise Text-to-SQL accuracy from 40% to 85-95% by providing structured context for AI.
A guide comparing vector stores like pgvector, Milvus, Weaviate, and LanceDB for retrieval workloads, focusing on index types and tradeoffs.
Troubleshooting guide for pasting images into Claude Code on Linux, focusing on missing clipboard utilities like xclip and wl-clipboard.
A developer shares a simple clustering algorithm for lists using sub-list reversals, inspired by playing with Magna-Tiles.
How to align photos for a time-lapse using OpenCV feature matching and RANSAC, overcoming camera and angle differences.
Armin Ronacher reflects on using AI agents (Pi) to build Pi, highlighting challenges with AI-generated bug reports.
Explores the 'orchestration tax' in AI agent workflows, comparing human cognitive limits to concurrent system bottlenecks.
Step-by-step guide to upgrade PostgreSQL from version 17 to 18 on Ubuntu 26.04 after a system update.
Analysis of how suddenly-great open source AI could pose an economic threat to the US by disrupting major tech companies.
Explores tabulation in double categories as an analog of profunctor graphs, using universal properties and 2-cells.
Explores the Hilbert transform as an infinite matrix, linking Fourier series and block matrix multiplication.
DeepSeek Sparse Attention implementation from scratch, featuring a learned sparse pattern replacing fixed attention with a lightweight indexer and selector.
