Перейти к содержимому

🚀 Built a complete ETL pipeline using Dataproc + PySpark on GCP!

Data Engineering With KD

0:00 / 0:00

🚀 Built a complete ETL pipeline using Dataproc + PySpark on GCP!

2 516 просмотров · 4 мес. назад
Data Engineering With KD
1,07 тыс. подписчиков
2 516 просмотров · 4 мес. назад
📌 Video Description In this video, we will build a real-world Data Engineering pipeline using Google Cloud Platform (GCP). 🔹 Services Used: • Cloud Storage (GCS) • Dataproc • PySpark • BigQuery 🔹 What You’ll Learn: ✅ How to create a Dataproc cluster ✅ Upload CSV files to Cloud Storage ✅ Read CSV files using PySpark ✅ Transform and process data ✅ Load data into BigQuery tables ✅ End-to-end ETL workflow on GCP This tutorial is beginner-friendly and useful for anyone preparing for Data Engineering interviews or learning cloud-based big data processing. 📌 Technologies Covered: • GCP Dataproc • Apache Spark • PySpark • Google BigQuery • Cloud Storage 👍 Don’t forget to Like, Share & Subscribe for more Data Engineering and GCP content! #GCP #Dataproc #PySpark #BigQuery #CloudStorage #DataEngineering #ETL #ApacheSpark #GoogleCloud #DataPipeline