MLOps for DevOps Engineers
A hands-on, project-based guide to Machine Learning Operations built specifically for DevOps, Platform, and SRE engineers.
No ML background required. Every concept is explained through DevOps analogies you already understand.
If you are completely new to MLOps, read our DevOps to MLOps guide first.
🌟🌟 If you are planning to use this repo for learning MLOps, please hit the star. Thanks!🌟🌟
Table of Contents
- Who This Is For
- What We Build
- Prerequisites
- Tech Stack
- Phase 1: Local Dev & Pipelines
- Phase 2: Enterprise Orchestration for ML
- Recommended MLOps Reading
Who This Is For
Most MLOps resources are written for data scientists learning infrastructure. This repo flips that.
You do not need to become a data scientist. But just like understanding how a Java application is built makes you a better DevOps engineer, understanding how an ML model is built, trained, and served makes you effective at operating ML workloads in production.
What We Build
We will start with the basics of building and training a classic ML model, then work our way up to production-ready MLOps.
Just like a DevOps engineer doesn't write the application but understands how it is built and deployed, an MLOps engineer doesn't need to be a data scientist. Understanding the ML workflow helps you build, automate, deploy, and troubleshoot ML systems effectively.
Everything in this roadmap runs on Kubernetes and Docker, and tools you will use in real-world MLOps platforms.
Tech Stack
Here is the tech stack you will be using in this setup.
| Category | Tools |
|---|---|
| Data Pipeline | Python, Airflow |
| Model Training | scikit-learn |
| API / Serving | FastAPI, Flask, Docker, KServe |
| ML Orchestration | Kubeflow, MLflow Pipelines |
| Monitoring | Evidently AI |
| Infrastructure | Kubernetes, Helm |
Phase 1: Local Development & Data Pipelines (Start Here)
Goal: Build the required ML foundation by building an Employee attrition prediction model from your local systems.
Use case throughout: Employee attrition prediction for a large organisation (~500,000 employees). One problem, end-to-end. Keeps the focus on infrastructure and operations, not data science theory.
| Step | Title | Guide |
|---|---|---|
| 1 | Project Dataset Pipeline | Read the Guide |
| 2 | Data Preparation Stages | Read the Guide |
| 3 | Training & Building the Prediction Model | Read the Guide |
| 4 | From Model to Live API with KServe | Read the Guide |
Code: phase-1-local-dev/
Phase 2: Enterprise Orchestration for ML
Goal: Replace local and manual ML workflows with automated, scalable, and production-ready workflows.
This phase covers the following key MLOps areas:
- Data Versioned workflow
- Automated data pipelines
- Scalable training pipelines
- Experiment tracking
- Scalable model deployment
- Model monitoring
The following guides explain each of these areas using specific open-source MLOps tools.
| Step | Title | Guide |
|---|---|---|
| 1 | Data Versioning Fundamentals | Read the Guide |
| 2 | Data Version Control (DVC) with AWS S3 | Read the Guide |
| 3 | Data Versioning using Airflow on Kubernetes | Read The Guide |
| 4 | Feature Store Fundamentals Explained | Read The Guide |
| 5 | Hands-on Feature Store with Feast on Kubernetes | Read The Guide |
| 6 | Kubeflow Explained for MLOps | Read The Guide |
| 7 | Hands-on Kubeflow on Kubernetes | Read The Guide |
| 8 | Kubeflow Trainer Explained (Hands-on) | Read the Guide |
| 9 | MLflow: A Practical Guide to Experiment Tracking | Read the Guide |
| 10 | KServe for MLOps: A Practical Guide | Read the Guide |
| 11 | Model Monitoring Explained | Read the Guide |
| 12 | Model Monitoring - Hands On | Read the Guide |
Code: phase-2-enterprise-setup/
Capstone MLOps Project: End-to-End MLOps Projects on Kubernetes | 🔜 Planned |
In this capstone project, you'll build a production-style MLOps platform on Kubernetes by combining everything you've learned throughout this series.
By the end, you'll have built an enterprise-grade MLOps workflow that mirrors how modern organizations develop, train, track, and operate machine learning models on Kubernetes.
Recommended Reading
- Google MLOps Whitepaper
- Volkswagen's End-to-End MLOps Platform on AWS
- Discord Single-Node to Multi-GPU Clusters
Certifications
MLOps Tools
- Ray: Open-source distributed computing framework For Python & AI Workloads
- CML: CI/CD for Machine Learning Projects
- Dagster: Cloud-native data pipeline orchestrator
- Kestra: Open-source orchestration platform for data, AI, and infrastructure workflows
- Flyte: AI orchestration in pure Python
License
Dual licensed:
- Code (scripts, configs, manifests) — Apache 2.0
- Content (README, guides, docs) — All Rights Reserved
For commercial licensing: contact@devopscube.com