🚀 Apache Iceberg + BigQuery | Episode 1
Data Engineering With KD
0:00 / 0:00
🚀 Apache Iceberg + BigQuery | Episode 1
309 просмотров · 9 дней назад
Data Engineering With KD
892 подписчика
309 просмотров · 9 дней назад
In this episode, we start from the fundamentals of Apache Iceberg and build our first Iceberg table using **BigQuery and Google Cloud Storage**.
📌 What you'll learn
00:00 – Introduction
01:00 – What is Apache Iceberg?
03:00 – Iceberg vs Parquet
04:30 – BigQuery + Iceberg Architecture
06:00 – GCP Setup
07:30 – Create BigQuery Connection
09:00 – Create First Iceberg Table
11:30 – Insert Data
13:00 – Query Iceberg Data with BigQuery
14:30 – Behind the Scenes
15:30 – What's Next?
🏗️ Architecture covered
Cloud Storage → Parquet → Apache Iceberg → BigQuery
You'll understand the difference between a *file format* like Parquet and a *table format* like Iceberg, and how Iceberg can be used as part of a modern lakehouse architecture.
🔥 Series Roadmap
*Episode 1:* Iceberg Fundamentals + First Table
*Episode 2:* INSERT, UPDATE, DELETE & MERGE
*Episode 3:* Schema Evolution + Time Travel
*Episode 4:* Iceberg + PySpark
*Episode 5:* Datastream + Iceberg + BigQuery
If you're learning **GCP, BigQuery, Data Engineering, PySpark or modern Lakehouse technologies**, make sure to subscribe to **Data Engineering With KD**.
👍 Like the video
🔔 Subscribe to the channel
💬 Comment *ICEBERG* if you want the complete hands-on project
#ApacheIceberg #BigQuery #GCP #GoogleCloud #DataEngineering #Lakehouse #PySpark #DataEngineeringWithKD