Перейти к содержимому

DuckLake Integration in Rosetta DBT Studio — Full Data Lake Management UI (Prototype)

DevForge

0:00 / 0:00

DuckLake Integration in Rosetta DBT Studio — Full Data Lake Management UI (Prototype)

34 просмотра · 8 дн. назад
DevForge
15 подписчиков
34 просмотра · 8 дн. назад
A prototype walkthrough of the complete DuckLake integration in Rosetta DBT Studio — a desktop app for data engineers built on Electron + DuckDB. This covers all 8 implementation phases (Plans 69a–69h), fully tested (81/81 checks passing): 📌 WHAT'S COVERED — DuckLake instance setup (DuckDB file, SQLite, PostgreSQL catalogs) — Capabilities overview per catalog type — Create tables with typed columns and partition rules — Reviewed schema edits: rename, add column, type widening (lossless only) — Safe import wizard: local files & object storage (S3 / MinIO / GCS) — Bad data protection: malformed rows roll back the whole transaction — Data Files & Partitions inspection — Time Travel: snapshot & date-time selectors, historical schema view — Change Feed: insert / update / delete chips between snapshots — Non-destructive maintenance: flush, merge, rewrite — Destructive maintenance with dry-run preview & drift protection — Quit guard and unknown-outcome recovery 🦆 What is DuckLake? DuckLake is an open table format built on DuckDB that stores metadata in SQL (DuckDB file, SQLite or PostgreSQL) and data as Parquet in local or object storage. More at: https://ducklake.select 🛠 Tech stack Electron + React + TypeScript @duckdb/node-api 1.5.5-r.1 DuckLake extension (v1.5-variegata) Catalog backends: DuckDB file, SQLite, PostgreSQL Storage: local, S3, MinIO, Azure Blob, GCS 📦 Rosetta DBT Studio GitHub: https://github.com/rosettadb/dbt-studio This feature is on the prototype branch and is pending final release review. #DuckLake #DuckDB #DataEngineering #OpenTableFormat #DataLake #ElectronApp #dbt