Перейти к содержимому

🚀 Apache Iceberg + BigQuery | Episode 1

Data Engineering With KD

0:00 / 0:00

🚀 Apache Iceberg + BigQuery | Episode 1

309 просмотров · 9 дней назад
Data Engineering With KD
892 подписчика
309 просмотров · 9 дней назад
In this episode, we start from the fundamentals of Apache Iceberg and build our first Iceberg table using **BigQuery and Google Cloud Storage**. 📌 What you'll learn 00:00 – Introduction 01:00 – What is Apache Iceberg? 03:00 – Iceberg vs Parquet 04:30 – BigQuery + Iceberg Architecture 06:00 – GCP Setup 07:30 – Create BigQuery Connection 09:00 – Create First Iceberg Table 11:30 – Insert Data 13:00 – Query Iceberg Data with BigQuery 14:30 – Behind the Scenes 15:30 – What's Next? 🏗️ Architecture covered Cloud Storage → Parquet → Apache Iceberg → BigQuery You'll understand the difference between a *file format* like Parquet and a *table format* like Iceberg, and how Iceberg can be used as part of a modern lakehouse architecture. 🔥 Series Roadmap *Episode 1:* Iceberg Fundamentals + First Table *Episode 2:* INSERT, UPDATE, DELETE & MERGE *Episode 3:* Schema Evolution + Time Travel *Episode 4:* Iceberg + PySpark *Episode 5:* Datastream + Iceberg + BigQuery If you're learning **GCP, BigQuery, Data Engineering, PySpark or modern Lakehouse technologies**, make sure to subscribe to **Data Engineering With KD**. 👍 Like the video 🔔 Subscribe to the channel 💬 Comment *ICEBERG* if you want the complete hands-on project #ApacheIceberg #BigQuery #GCP #GoogleCloud #DataEngineering #Lakehouse #PySpark #DataEngineeringWithKD