Перейти к содержимому

Building a Banking Data Pipeline: From Raw Data to KPIs #16

Joseph Cloud Labs

0:00 / 0:00

Building a Banking Data Pipeline: From Raw Data to KPIs #16

6 просмотров · 13 дн. назад
Joseph Cloud Labs
67 подписчиков
6 просмотров · 13 дн. назад
In Part 16 of the Banking Data Pipeline series, we turn our processed banking customer data into business KPIs using SQL aggregations in Amazon Athena: total customers, customers by country and customers by segment. Each KPI is one short query on the customers table in our S3 data lake, built with COUNT(*), GROUP BY and ORDER BY. We also look at why a row count and a count of distinct customer IDs aren't always the same KPI, and why the business and data teams should agree the definition. All customer data shown is synthetic test data. Chapters 0:00 Intro 0:49 Opening Athena on the processed customers table 1:45 KPI 1: total customers with COUNT(*) 3:21 Row count vs distinct customer IDs 3:32 KPI 2: customers by country with GROUP BY 5:32 KPI 3: customers by segment with ORDER BY 7:56 Your turn: segment percentages 8:39 What's next Next up — Part 17: Validating and Optimizing Athena Queries. Previous — Part 15: Querying Athena Tables on S3 Data with SQL: [ADD LINK] Full playlist: [ADD LINK] Which SQL KPI would you build next? Tell me in the comments. #AWS #AmazonAthena #DataEngineering