Next Level Iceberg: Maintenance, Catalogs and Spec Evolution

​What It Is About

Apache Iceberg is more than just the leading open table format; it is becoming the standard in today’s data ecosystem. A few months ago, we hosted a webinar with Alex, Roy, and Yingjun that covered why to use Iceberg, who should adopt it, the different catalog types, and the challenges of managing Iceberg, ranging from ingestion issues to compaction, RBAC, and the complexities of self-hosting. It became clear that while Iceberg is powerful, maintaining it often demands a hefty tech stack and significant effort, especially in streaming use cases.

​Now, four months and many exciting ecosystem updates later, including the release of the V3 spec, we are back to continue the conversation, dive deeper into the topics you asked about, and look ahead to what is coming next. We will revisit compaction strategies with a cost-based comparison, explore catalog management with a breakdown of the pros and cons of different options, and wrap up a discussion on the upcoming Iceberg V4 and what the community should expect.

​Plus, a small surprise awaits: if you have not heard of Nimtable yet, get ready for an exclusive sneak peek at how it makes managing Iceberg easier for teams even without a large DevOps staff.

​Speakers:

• ​Rayees Pasha, CPO at RisingWave Labs

• ​Alex Merced, Head of Devrel at Dremio

• ​Roy Hasson, Sr. Director of Product at Microsoft