Netflix for Scientific Software: Inside EESSI

Installing scientific software on a supercomputer can take hours — and that's if it works the first time. Kenneth Hoste has spent over a decade trying to make that problem disappear, and his answer sounds a lot like Netflix: instead of building software yourself, you stream a pre-built binary, tuned for your exact CPU, in minutes. Featured in this episode: Kenneth Hoste — lead developer of EasyBuild and core contributor to EESSI (European Environment for Scientific Software Installations), HPC systems administrator at Ghent University We caught up with Kenneth at ISC in Hamburg to talk about how EESSI works under the hood: a curated catalog of roughly 800 top-level applications (closer to 6,000 once you count Python and R extensions), built up to 15 times per package for different CPU generations across x86, ARM, and — increasingly — RISC-V. The distribution layer is CernVM-FS, the same technology CERN built to push software to LHC data centers worldwide, which caches locally and updates automatically the moment something new is added. CHAPTERS 00:00 What is EESSI? Streaming software like Netflix 02:52 Meeting Kenneth at ISC: what "streaming an application" means 04:43 Before EasyBuild and Spack: the dark old days 07:00 800 applications, one curated catalog 09:29 CernVM-FS: built for the LHC, repurposed for HPC 13:02 Mandated across every EuroHPC supercomputer 25:51 The AI question: policy, threat, or both? #ai #hpc #scientificcomputing #opensource #supercompputer #supercomputing