Casting the spell: Druid in practice - Itai Yaffe, Yakir Buskilla

Thank you to all of of our ApacheCon@Home 2021 sponsors, including: STRATEGIC --------------- Google PLATINUM -------------- Apple Huawei Instaclustr Tencent Cloud GOLD ----------- Aiven OY AWS Baidu Cerner Didi Chuxing Dremio Fiter Gradle Red Hat Replicated A presentation from ApacheCon@Home 2021 https://apachecon.com/acah2021 At Nielsen Identity, we leverage Apache Druid to provide our customers with real-time analytics tools for various use-cases, including in-flight analytics, reporting and building target audiences. The common challenge of these use-cases is counting distinct elements in real-time at scale. We’ve been using Druid to solve these problems for the past 5 years, and gained a lot of experience with it. In this talk, we will share some of the best practices and tips we’ve gathered over the years. We will cover the following topics: Data modeling Ingestion Retention and deletion Query optimization