Перейти к содержимому

Snowflake, dbt, Airflow Project | PostgreSQL, SQL, Data Engineering

F K

0:00 / 0:00

Snowflake, dbt, Airflow Project | PostgreSQL, SQL, Data Engineering

209 просмотров · 10 дн. назад
F K
411 подписчиков
209 просмотров · 10 дн. назад
End-to-end data engineering project with Snowflake, dbt, Airflow, PostgreSQL, and SQL. Don't learn Snowflake alone. Build the whole analytics stack. This is the intro. A bank with 520 branches already has every answer in PostgreSQL, and it still cannot ask a big question without slowing down the customer at the ATM. In this episode: Meridian Bank: 520 branches, 5 countries, 5 currencies, 200,000 customers, 5 million payments The questions leadership cannot ask today OLTP versus OLAP, and why a read-only copy of PostgreSQL is not enough One job each: PostgreSQL, Python, Parquet, Snowflake, dbt, Airflow, Streamlit, Docker, GitHub Actions The bank is fictional. The tools and the pipeline are real. Later episodes build the source database, the Snowflake warehouse, the Python load, the dbt models, the Airflow schedule, data quality, and asking the data in English. Playlist: End-to-End Data Engineering Project | PostgreSQL, Snowflake, dbt, Airflow #Snowflake #dbt #DataEngineering