Kevin Dubois & Cedric Clyburn

Bootable AI Containers with Podman Desktop

What if you could solve dependency hell by packaging your entire OS, AI model, and app into a single, bootable container image?

Bootable AI Containers with Podman Desktop
#1about 3 minutes

Introducing bootable containers and the CNCF donation

An overview of the session's agenda and the announcement of Red Hat's container tools, including bootable containers, being donated to the CNCF.

#2about 4 minutes

Solving OS management challenges with bootable containers

Bootable containers apply the immutable, standardized principles of application containers to entire operating systems to prevent configuration drift.

#3about 3 minutes

The workflow for deploying and updating bootable systems

A container file is used to build a bootable image, which is then converted to a disk image for deployment and can be updated by pulling a new version from a registry.

#4about 4 minutes

Building a bootable OS image with a container file

The `bootc` tool manages updates and rollbacks, while a container file defines the OS layers, packages, and applications, and you can even build a custom base image.

#5about 3 minutes

Why bootable containers are ideal for AI and ML stacks

Packaging AI/ML stacks as bootable containers solves dependency issues and allows models to run closer to the hardware for faster inference.

#6about 2 minutes

Simplifying the build process with Podman Desktop

Podman Desktop and its extensions provide a user-friendly interface to build a bootable container image and export it to various disk formats.

#7about 5 minutes

Demo: Developing a local AI code assistant application

A demonstration of building and running a Python-based AI code generation application as a standard container using the Podman Desktop AI Lab extension.

#8about 7 minutes

Demo: Packaging the AI app as a bootable container

The AI application is packaged into a bootable CentOS Stream image using a container file that includes the model, server, and systemd services.

Related jobs
Jobs that call for the skills explored in this talk.

test

Milly
Vienna, Austria

Intermediate

test

Milly
Vienna, Austria

Intermediate

d

Saby Company
Delebio, Italy

Junior

Featured Partners

Related Articles

View all articles
Learning Kubernetes made easy with KubeCampus
Learning to use Kubernetes? KubeCampus by Kasten offers free educational content for all skill levels to get you started!Kubernetes is an open-source system for deploying, scaling and managing containerized applications. It allows you to deploy your ...
Learning Kubernetes made easy with KubeCampus
DC
Daniel Cranney
Building AI Solutions with Rust and Docker
In recent years, artificial intelligence has surged in popularity in the world of development. While Python remains a popular choice in the realm of AI, Rust - often known as Rust Lang - is quickly emerging as a formidable alternative.Rust programmin...
Building AI Solutions with Rust and Docker
CH
Chris Heilmann
All the videos of Halfstack London 2024!
Last month was Halfstack London, a conference about the web, JavaScript and half a dozen other things. We were there to deliver a talk, but also to record all the sessions and we're happy to share them with you. It took a bit as we had to wait for th...
All the videos of Halfstack London 2024!

From learning to earning

Jobs that call for the skills explored in this talk.