Automated Materialized Views in Dremio
Explores Dremio's automated materialized views and reflections for optimizing AI-era lakehouse workloads beyond static cron-based maintenance.
Explores Dremio's automated materialized views and reflections for optimizing AI-era lakehouse workloads beyond static cron-based maintenance.
Explains why a native variant type in Apache Iceberg is needed for semi-structured AI data like LLM outputs and agent logs.
Explores how AI agent write patterns stress Apache Iceberg tables and offers patterns like partition isolation and commit queues to maintain performance.
Explains credential vending for Iceberg REST catalogs, replacing static cloud keys with short-lived, scoped storage credentials for secure multi-engine lakehouses.
Analysis of Apache Iceberg REST Catalog V2 design addressing protocol debt, scaling challenges, and multi-engine optimization for modern data workloads.
Explores concurrency challenges in agentic lakehouses with Iceberg, balancing academic proofs and high-frequency production writes.
Explores an architecture pattern combining Amazon S3 Tables and MCP for governed conversational AI access to Iceberg data.
A deep dive comparing block vs. object storage, explaining how lakehouses made slower object storage fast for analytics.
Analysis of Apache Iceberg v4 performance focusing on metadata round trips, root manifests, and object storage latency for platform engineers.
Analysis of REST Catalog V2 LoadTable and client capability negotiation for lakehouse platforms.
Analysis of Rust vs C++ for building native Iceberg scan operators, focusing on production performance, safety, and interoperability.
Explains the four-layer architecture of an agentic lakehouse for reliable AI agent data access.
Explores concurrency and isolation challenges when AI agents write to Apache Iceberg lakehouses, covering OCC mechanics, failure modes, and architectural patterns.
Explains Iceberg remote signing for regulated datasets, enhancing security by issuing per-file, one-time-use pre-signed URLs instead of storage credentials.
This article discusses authentication and authorization patterns for securing AI agent identities in the Iceberg lakehouse, including OAuth 2.0 token exchange and credential vending.
Explains Snowflake's bidirectional Iceberg writes via Horizon Catalog, powered by Apache Polaris, enabling external engines to write to Snowflake-managed Iceberg tables.
Analysis of zero-copy mirroring for safer lakehouse migration, focusing on architecture, governance, and multi-engine data platforms.
Best practices for managing Apache Iceberg snapshot expiration in data lakehouses to optimize query performance and metadata size.
Explains designing an open catalog architecture for AI agents in an agentic lakehouse, covering Apache Polaris and Dremio's Open Catalog.
Explores using DuckDB and Polars to query and write to Iceberg tables, covering new features, workflows, and practical patterns.