Skip to main content

Effortless Distributed Computing in Python

UD2.218A | Day 2 | 15:30 - 16:00 | Speakers: Raphael Javaux

Effortless Distributed Computing in Python
A picture of a devroom at FOSDEM 2024
Open in browser

Notes

Abstract

In this talk, Raphael will share his experience taking part to the development of 3 new packages dedicated to the parallelization of distributed Python workloads:

  • Scaler, a light-weight and resilient distributed task scheduler for Python;
  • Parfun, an easy to use map-reduce decorator for Python;
  • Pargraph a battle-tested distributed graph engine for Python.

The talk will show examples on how to leverage these three projects for efficient distributed computations.

Attachments

Speakers

Raphael Javaux

Notice: The placeholder video image is licensed under CC BY-SA 4.0. The original image can be found hereChanges made to the image are: Cropped the image to a new ratio, part of the image was cut off.