Skip to main content

Keeping the P in HPC: the EESSI Way

H.1301 (Cornil) | Day 2 | 10:30 - 11:10 | Speakers: Kenneth Hoste

Keeping the P in HPC: the EESSI Way
A picture of a devroom at FOSDEM 2024
Open in browser
Get involved in the conversation!Join the chat

Notes

Abstract

In scientific computing on supercomputers, performance should be king. Today’s rapidly diversifying High-Performance Computing (HPC) landscape makes this increasingly difficult to achieve however...

Modern supercomputers rely heavily on open source software, from a Linux-based operating system to scientific applications and their vast dependency stacks. A decade ago, HPC systems were relatively homogeneous: Intel CPUs, a fast interconnect like Infininand, and a shared filesystem. Today, diversity is the norm: AMD and Intel CPUs, emerging Arm-based exascale systems like JUPITER, widespread acceleration with NVIDIA and AMD GPUs, soon also RISC-V system architectures (like Tenstorrent), etc.

This hardware fragmentation creates significant challenges for researchers and HPC support teams. Getting scientific software installed reliably and efficiently is more painful than ever, and that’s before even considering software performance.

Containers, once heralded as the solution for mobility-of-compute, are increasingly showing their limits. An x86_64 container image is useless on a system with Arm CPUs, and will be equally useless on RISC-V in the not so distant future. What's worse is that portable container images used today already sacrifice performance by avoiding CPU-specific instructions like AVX-512 or AVX10, potentially leaving substantial performance gains on the table. Containerization also complicates MPI-heavy workloads and introduces friction for HPC users.

This talk introduces the European Environment for Scientific Software Installations (EESSI), which tackles these challenges head-on with a fundamentally different approach. EESSI is a curated, performance-optimized scientific software stack powered by open source technologies including CernVM-FS, Gentoo Prefix, EasyBuild, Lmod, Magic Castle, ReFrame, etc.

We will show how EESSI enables researchers to use the same optimized software stack seamlessly across laptops, cloud VMs, supercomputers, CI pipelines, and even Raspberry Pis—without sacrificing performance or ignoring hardware differences. This unlocks powerful workflows and simplifies software management across heterogeneous environments.

EESSI is already being adopted across European supercomputers and plays a central role in the upcoming EuroHPC Federation Platform.

Come learn why EESSI is the right way to keep the P in HPC.

Attachments

Speakers

Kenneth Hoste

Kenneth Hoste, a.k.a. @boegel, is a computer scientist and FOSS enthusiast from Belgium.

Since October 2010, he is a member of the HPC team at Ghent University (Belgium) where he is mainly responsible for user support & training. As a part of his job, he is also the lead developer and release manager of EasyBuild (https://easybuild.io), a software build and installation framework for (scientific) software on High Performance Computing (HPC) systems, as well a a core contributor to the European Environment for Scientific Software Installations (EESSI, https://eessi.io). In addition, he is an active contributor to both MultiXscale, a EuroHPC Centre-of-Excellence (https://multixscale.eu), and the EuroHPC Federation Platform (https://my-eurohpc.eu).

In his free time, he is a family guy and a fan of loud music, frequently attending gigs and festivals.

He enjoys helping people & sharing his expertise, and likes joking around.

He is willing to trade stickers for beer (you bring the beer), but he can be quite picky about the type of beer.

He is an avid FOSDEM attendee since 2012, and lead organizer of the "HPC, Big Data, and Data Science" devroom at FOSDEM.


Notice: The placeholder video image is licensed under CC BY-SA 4.0. The original image can be found hereChanges made to the image are: Cropped the image to a new ratio, part of the image was cut off.