Amazon Web Services

In this AWS re:Invent 2023 session, Netflix engineers Ashwin Kayyoor and Rakesh Veeramacheneni share their journey of modernizing Netflix's massive data lake using Apache Iceberg. They discuss the challenges of managing an exabyte-scale data warehouse and the transition from a Hive-based system to an Iceberg-only architecture. The presentation covers the development of custom tooling, ecosystem services, and unique features like secure Iceberg tables and the Iceberg REST catalog. The speakers detail the migration process, including strategies to minimize data movement and user friction while ensuring business continuity. They also highlight the benefits of Iceberg, such as ACID transactions, rich metadata layers, and improved query performance. The talk provides valuable insights for organizations looking to scale their data infrastructure and leverage open-source table formats for efficient data management.

customer-stories
product-information
skills-and-how-to
media-and-entertainment
data
Show 7 more

Up Next

VideoThumbnail
7:33

วิธีการใช้งาน AWS Compute Optimizer (Level 200)

Jun 26, 2025
VideoThumbnail
4:38

วิธีการสร้าง Amazon Machine Image (AMI) (Level 200)

Jun 26, 2025
VideoThumbnail
11:06

การจัดการการใช้งานคลาวด์แบบ Multi-Account ด้วย AWS Organization และ Landing Zone (Level 200)

Jun 26, 2025
VideoThumbnail
7:36

การใช้ Amazon Workspace เพื่อช่วยลดค่าใช้จ่ายในการทำ BCP (Level 200)

Jun 26, 2025
VideoThumbnail
8:03

การย้ายข้อมูลบนระบบฐานข้อมูลด้วย AWS DMS และ AWS SCT (Level 200)

Jun 26, 2025