Tag: Data Engineering

All the articles with the tag "Data Engineering".

31 MIN READ•Jul 28, 2026
Why Iceberg V4 Wants to Retire Equality Deletes, and What Streaming Teams Should Do About It
Equality deletes made streaming upserts into Iceberg practical at the cost of read performance. V4 proposes retiring them in favor of deletion vectors with an async conversion path.
Apache IcebergStreamingData Engineering
31 MIN READ•Jul 28, 2026
Surviving Commit Conflicts When Dozens of Writers Hit the Same Iceberg Table
Commit conflicts multiply with writer count, and AI agents introduce unpredictable write patterns. Here's how to diagnose, tune, and architect around Iceberg's optimistic concurrency.
Apache IcebergConcurrencyData Engineering
31 MIN READ•Jul 28, 2026
The Parquet Versioning Problem, and Why Iceberg Cares About It
Parquet files have a version field that doesn't reliably signal feature requirements. A new versioning discipline is coming, borrowing from Iceberg's format version model.
ParquetApache IcebergData Engineering

Why Iceberg V4 Wants to Retire Equality Deletes, and What Streaming Teams Should Do About It