Skip to main content

Building AI Applications from your desktop with Podman AI Lab

UB2.252A (Lameere) | Day 2 | 13:20 - 13:40 | Speakers: Cedric Clyburn, Stevan Le Meur

Building AI Applications from your desktop with Podman AI Lab
A picture of a devroom at FOSDEM 2024
Open in browser

Notes

Abstract

Generative AI is revolutionizing how we build modern applications, but for developers, it can be daunting, particularly with evaluating models, building with Gen AI, and the path to production. But, it doesn’t have to be worrisome! Join us in this session to be ahead of the curve when it comes to AI-enabled cloud-native application development.

Using container technology and open source models from Hugging Face, we’ll show how to practically integrate Gen AI in an existing application from your local development environment and ultimately deploy it onto Kubernetes. Why work with local and open-source models? From reducing cloud computing costs, keeping control of your sensitive data, and alleviating vendor-locking, it’s an increasingly popular way for developers to prototype AI applications quickly. We’ll demonstrate a sample of the whole AI journey, starting from assessing models, building applications with LLMs, and deploying/serving AI applications.

Attachments

Speakers

Cedric Clyburn
Stevan Le Meur

Notice: The placeholder video image is licensed under CC BY-SA 4.0. The original image can be found hereChanges made to the image are: Cropped the image to a new ratio, part of the image was cut off.