Dubravko Dolic & Hüdaverdi Cakir
Industrializing your Data Science capabilities
#1about 2 minutes
The challenge of industrializing data science models
A tire recall incident highlights the gap between a data scientist's local Python script and a scalable, production-ready solution.
#2about 3 minutes
Building the initial concept for a data science factory
The journey began with a demand forecasting use case, leading to the concept of a lab for experimentation and a factory for industrialization.
#3about 5 minutes
Establishing processes and a cloud-agnostic tool stack
A standardized process with dev, QA, and prod stages was created, supported by a cloud-agnostic tool stack including Git, Jenkins, and Kubernetes.
#4about 5 minutes
Technical architecture for a multi-stage deployment environment
The architecture uses Kubernetes and containerization to create reproducible dev, QA, and prod environments with immutable builds and stage-specific configurations.
#5about 11 minutes
Live demo of deploying and promoting application versions
A command-line interface is used to deploy a new version of a Shiny application to the dev environment and promote an existing build from dev to QA.
#6about 5 minutes
Monitoring applications with logs and metrics
The platform provides developers with access to Elastic Stack for log aggregation and Prometheus with Grafana for metrics to monitor application performance.
#7about 2 minutes
Providing a simplified lab environment for data scientists
A web-based frontend offers pre-configured templates for RStudio and Python, abstracting away infrastructure complexity for data scientists.
#8about 4 minutes
Real-world use cases from tire manufacturing
Several applications are showcased, including real-time tire monitoring for mining trucks, optimizing material mixing, and deploying scrap prediction models to edge devices.
#9about 6 minutes
Integrating the factory into a larger analytics ecosystem
The Data Science Factory is part of a broader ecosystem that includes a telemetry backbone, image recognition pipelines, and predictive maintenance platforms.
Related jobs
Jobs that call for the skills explored in this talk.
Matching moments
02:48 MIN
Merging data engineering and DevOps for scalability
Software Engineering Social Connection: Yubo’s lean approach to scaling an 80M-user infrastructure
17:33 MIN
Bridging gaps with DevOps and containerization
From Punch Cards to AI-assisted Development
18:10 MIN
Managing massive data scales with the Robotic Drive platform
How to develop an autonomous car end-to-end: Robotic Drive and the mobility revolution
18:06 MIN
Using data management and open source tools for MLOps
MLOps - What’s the deal behind it?
00:18 MIN
From research concepts to production-ready data products
Implementing continuous delivery in a data processing pipeline
12:06 MIN
A platform for self-service infrastructure and environments
Let developers develop again
23:02 MIN
Applying TDD, CI/CD, DevOps, and SAFe at scale
Agile work at CARIAD – Creating a customer web application for controlling the vehicle
55:32 MIN
Q&A: MLOps tools for building CI/CD pipelines
Data Science in Retail
Featured Partners
Related Videos
DevOps for Machine Learning
Hauke Brammer
AI beyond the code: Master your organisational AI implementation.
Marin Niehues
DevOps for AI: running LLMs in production with Kubernetes and KubeFlow
Aarno Aukia
From Factory Floor to Kubernetes Core: Building an Edge Platform One Step at a Time
Dean Oren & Stefan Belsch
Empowering Thousands of Developers: Our Journey to an Internal Developer Platform
Bastian Heilemann & Bruno Margula
Implementing continuous delivery in a data processing pipeline
Álvaro Martín Lozano
Empowering Retail Through Applied Machine Learning
Christoph Fassbach & Daniel Rohr
DataForce Studio
Iryna Kondrashchenko & Oleh Kostromin
Related Articles
View all articles
.gif?w=240&auto=compress,format)


From learning to earning
Jobs that call for the skills explored in this talk.


Senior DevOps Engineer - Edge Data Platform (all genders)
SYSKRON GmbH
Regensburg, Germany
Intermediate
Senior
.NET
Python
Kubernetes






