Snowflake, dbt, Airflow Project | PostgreSQL, SQL, Data Engineering
F K
0:00 / 0:00
Snowflake, dbt, Airflow Project | PostgreSQL, SQL, Data Engineering
209 просмотров · 10 дн. назад
F K
411 подписчиков
209 просмотров · 10 дн. назад
End-to-end data engineering project with Snowflake, dbt, Airflow, PostgreSQL, and SQL. Don't learn Snowflake alone. Build the whole analytics stack.
This is the intro. A bank with 520 branches already has every answer in PostgreSQL, and it still cannot ask a big question without slowing down the customer at the ATM.
In this episode:
Meridian Bank: 520 branches, 5 countries, 5 currencies, 200,000 customers, 5 million payments
The questions leadership cannot ask today
OLTP versus OLAP, and why a read-only copy of PostgreSQL is not enough
One job each: PostgreSQL, Python, Parquet, Snowflake, dbt, Airflow, Streamlit, Docker, GitHub Actions
The bank is fictional. The tools and the pipeline are real. Later episodes build the source database, the Snowflake warehouse, the Python load, the dbt models, the Airflow schedule, data quality, and asking the data in English.
Playlist: End-to-End Data Engineering Project | PostgreSQL, Snowflake, dbt, Airflow
#Snowflake #dbt #DataEngineering