The Coupling Wars: Hyperconverged vs Disaggregated Storage
The Shadow Brains
0:00 / 0:00
The Coupling Wars: Hyperconverged vs Disaggregated Storage
2 просмотра · 18 ч назад
The Shadow Brains
10 подписчиков
2 просмотра · 18 ч назад
Separating drives from processors does not eliminate scaling bottlenecks. It relocates them. This fictional case study follows a city camera archive and a regional bank through a flash price shock and a six-hour fabric outage to show where each architecture breaks.
This is a fictional case study: Kestrel Systems, Meridian Data, Lumen Silicon, the Metro Vision Authority, Harbor Line Bank and the 2026–2029 events are invented to illustrate a real architectural trade-off.
It starts with unstructured data outgrowing GPU compute and the two answers: hyperconverged infrastructure (HCI), which binds CPU and drives in one chassis and charges a controller tax of up to 12 vCPUs and 32 GB of RAM per node, and disaggregated shared-everything (DSE), where stateless compute reaches pooled flash over NVMe over Fabrics. A 35% QLC flash price rise meets replication factor 2 on HCI (80 PB of hardware for 40 PB of video), while DSE's wide erasure coding (146 data + 4 parity) cuts the redundancy overhead from 50% to 2.7%. Then a switch firmware bug paralyses a DSE cluster for six hours: shared fate puts the central fabric between every server and every drive, while HCI's data locality keeps local VMs reading their own disks. A bank keeps its transaction ledgers on HCI for deterministic latency; the camera authority splits its tiers; and the hyperconverged vendor adds external flash shelves, producing today's hybrid rule: local NVMe for databases, dense external flash for capacity. Coupling is never removed; you choose whether to be bound by local silicon or exposed to a network switch.
Explainer generated with AI (NotebookLM video overview); intro, outro and edit by The Shadow Brains. Music: original, synthesized.
Chapters
0:03 Data outgrows compute
0:26 HCI versus disaggregated shared-everything
1:12 The controller tax
1:34 Stateless brain servers
2:00 What the spreadsheet ignores
2:25 The 35% flash price shock
2:46 40 petabytes on replication factor 2
3:30 Wide erasure coding: 2.7% overhead
3:59 May 2027: a switch takes the cluster down
4:27 Shared fate
4:47 HCI's failure geometry
5:16 The failure domain moves outside the chassis
5:42 The bank chooses determinism
6:28 Splitting the tiers
7:17 The market fractures
7:37 Hyperconverged meets external flash
8:23 Workload-aware segmentation
8:50 Coupling is never removed
9:23 Key moments
#DataCenter #Storage #SystemDesign