Перейти к содержимому

DataFusion Community Showcase Vol. 7: Bauplan & Phoebe Genomics

Spice AI

0:00 / 0:00

DataFusion Community Showcase Vol. 7: Bauplan & Phoebe Genomics

90 просмотров · 6 дн. назад
Spice AI
209 подписчиков
90 просмотров · 6 дн. назад
Recorded live on October 15th, 2026, this was the seventh DataFusion Community Showcase highlighting two DataFusion projects: ​1) Jacopo Tagliabue, Bauplan ​"DF makes plans and AI laughs: LLM-based query optimization" ​​We explore how large language models can improve DataFusion’s query plans through targeted edits and evolutionary search, building a custom plan serializer and a new evaluation harness for correctness and performance. On workloads modeled on TPC-H and TPC-DS, we achieve speedups of up to 4.78× over baseline plans on individual queries, with selected improvements transferring to larger datasets. ​2) Tim Poterba, Phoebe Genomics ​"Phoebe: a domain-optimized database built on DAVE (Datafusion, Arrow, Vortex, Embedded)" ​Analytical databases optimized for weird domain data and weird domain queries outperform general solutions. Domain-optimized databases used to be huge projects, but with Datafusion Arrow / Vortex, you can spend all your time on the domain optimizations extending these fantastic general storage/computequery engines. Learn more about the DataFusion Community Showcase and sign-up to present here: https://github.com/apache/datafusion/...