Kubernetes Ml Deployment MLOps Tools

There are 90 kubernetes ml deployment tools tracked. 5 score above 70 (verified tier). The highest-rated is skypilot-org/skypilot at 80/100 with 9,569 stars. 7 of the top 10 are actively maintained.

Get all 90 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=mlops&subcategory=kubernetes-ml-deployment&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	skypilot-org/skypilot Run, manage, and scale AI workloads on any AI infrastructure. Use one system...	80	Verified	9,569	Python
2	dstackai/dstack dstack is an open-source control plane for running development, training,...	77	Verified	2,062	Python
3	ray-project/kuberay A toolkit to run Ray applications on Kubernetes	71	Verified	2,370	Go
4	kubeflow/kale Kubeflow’s superfood for Data Scientists	71	Verified	674	Python
5	volcano-sh/volcano A Cloud Native Batch System (Project under CNCF)	71	Verified	5,375	Go
6	m3dev/gokart Gokart solves reproducibility, task dependencies, constraints of good code,...	67	Established	336	Python
7	run-house/kubetorch Distribute and run AI workloads on Kubernetes magically in Python, like...	62	Established	1,172	Python
8	kubeflow/arena A CLI for Kubeflow.	61	Established	809	Go
9	clearml/clearml-server ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment...	61	Established	448	Python
10	Meesho/BharatMLStack BharatMLStack is an open-source, end-to-end machine learning infrastructure...	60	Established	675	Go
11	secretflow/kuscia Kuscia(Kubernetes-based Secure Collaborative InfrA) is a K8s-based...	60	Established	137	Go
12	kubeflow/blog Kubeflow blog based on fastpages	58	Established	32	Jupyter Notebook
13	caraml-dev/merlin Kubernetes-friendly ML model management, deployment, and serving.	58	Established	183	Go
14	kubeflow/kubeflow Machine Learning Toolkit for Kubernetes	55	Established	15,511	—
15	nebius/soperator Run Slurm in Kubernetes	55	Established	368	Go
16	jay-johnson/deploy-to-kubernetes Deploy a distributed AI stack to a multi-host or single-host Kubernetes...	54	Established	83	Shell
17	containers/omlmd OCI Artifact for ML model & metadata	54	Established	79	Python
18	raids-lab/crater Crater is a cloud-native AI training & inference platform.	54	Established	162	TypeScript
19	burakince/mlflow Mlflow Docker Image	53	Established	26	Python
20	microsoft/pai Resource scheduling and cluster management for AI	51	Established	2,685	JavaScript
21	kubernetes-retired/kube-batch A batch scheduler of kubernetes for high performance workload, e.g. AI/ML,...	51	Established	1,092	Go
22	apache/submarine Submarine is Cloud Native Machine Learning Platform.	51	Established	705	Java
23	SeldonIO/seldon-server Machine Learning Platform and Recommendation Engine built on Kubernetes	51	Established	1,477	Java
24	KusionStack/kusion Declarative Intent Driven Platform Orchestrator for Internal Developer...	50	Established	1,281	Go
25	kubeflow/example-seldon Example for end-to-end machine learning on Kubernetes using Kubeflow and Seldon Core	48	Emerging	172	Jupyter Notebook
26	aws-samples/machine-learning-using-k8s Train and Deploy Machine Learning Models on Kubernetes using Amazon EKS	48	Emerging	169	—
27	katanaml/katana-skipper Simple and flexible ML workflow engine	48	Emerging	423	Python
28	deployKF/deployKF deployKF builds machine learning platforms on Kubernetes. We combine the...	47	Emerging	465	Shell
29	kubedl-io/kubedl Run your deep learning workloads on Kubernetes more easily and efficiently.	46	Emerging	531	Go
30	polyaxon/mloperator Machine learning operator & controller for Kubernetes	46	Emerging	94	Go
31	kleveross/klever-model-registry Cloud Native Machine Learning Model Registry	45	Emerging	82	Go
32	kleveross/ormb Docker for Your ML/DL Models Based on OCI Artifacts	45	Emerging	474	Go
33	provectus/sak-kubeflow 🚀 Deploy Kubeflow on AWS EKS with Terraform 🤖	44	Emerging	64	HCL
34	treebeardtech/kubeflow-bootstrap 🪐 1-click Kubeflow using ArgoCD	44	Emerging	72	Shell
35	microsoft/hivedscheduler Kubernetes Scheduler for Deep Learning	44	Emerging	264	Go
36	kleveross/klever Cloud Native ML/DL Platform	43	Emerging	133	—
37	Lightning-AI/ecosystem-ci Automate issue discovery for your projects against Lightning nightly and releases.	42	Emerging	46	Python
38	m3dev/kannon Kannon is a wrapper for the gokart library that allows gokart tasks to be...	42	Emerging	26	Python
39	docker-aiml/tech-stack-advisor Tech Stack Advisor Sample ML App - Project to Learn to Package ML App with...	41	Emerging	4	Python
40	codewithmuh/react-aws-eks-github-actions We plan to utilize GitHub Actions and Terraform to deploy our React project...	40	Emerging	8	HCL
41	k3ai/k3ai A lightweight tool to get an AI Infrastructure Stack up in minutes not days....	40	Emerging	125	Go
42	kf5i/k3ai-core K3ai-core is the core library for the GO installer. Go installer will...	40	Emerging	24	Go
43	h2oai/h2o-kubernetes H2O Open Source Kubernetes operator and a command-line tool to ease...	39	Emerging	25	Rust
44	clouatre-labs/setup-kiro-action GitHub Action to install and cache Kiro CLI for workflows	39	Emerging	5	—
45	freed-dev-llc/turing-rk1-cluster 4-node bare-metal Kubernetes cluster on Turing RK1 (RK3588) with Talos...	38	Emerging	3	Shell
46	AICoE/thanos-openshift Thanos on OpenShift	38	Emerging	11	—
47	AICoE/openshift_kubeflow_workshop Kubeflow on OpenShift	37	Emerging	14	Python
48	kf5i/k3ai K3ai is a lightweight, fully automated, AI infrastructure-in-a-box solution...	37	Emerging	102	PowerShell
49	slai-labs/get-beam Run GPU inference and training jobs on serverless infrastructure that scales...	37	Emerging	102	Shell
50	PapiHack/gai-demo Demo project of my talk for Galsen AI Dakar community on How to Deploy &...	35	Emerging	10	Python
51	k3ai/plugins A lightweight tool to get an AI Infrastructure Stack up in minutes not days....	35	Emerging	6	—
52	ccheshirecat/fledge Fledge converts applications into bootable microvm artifacts. Feed it an OCI...	34	Emerging	7	Go
53	polyaxon/polyaxon-operator Polyaxon Operator & Controller for Kubernetes	34	Emerging	6	Go
54	Roulbac/pulumi-eks-ml An infrastructure library for building scalable Machine Learning platforms on AWS.	33	Emerging	10	Python
55	ParadigmAI/paradigm Hassle-free ML Pipelines on Kubernetes	33	Emerging	39	Python
56	robolaunch/robot-operator Kubernetes Robot Operator for ROS/2 Based Robots	32	Emerging	30	Go
57	helmcode/kubectl-ai Kubectl plugin for AI-assisted Kubernetes cluster management	31	Emerging	2	Go
58	lambdazy/lzy Platform for a hybrid execution of ML workflows that transparently...	31	Emerging	72	Java
59	egdaemon/eg The only developer focused ci/cd platform.	31	Emerging	11	Go
60	ashishpatel26/Kubeflow-installation-on-windows-10 Kubeflow installation on windows 10/11	31	Emerging	17	—
61	ArdentMC/ai-streamliner The AI Streamliner Project	30	Emerging	24	Batchfile
62	perlogix/dama a simplified machine learning container platform that helps teams get...	29	Experimental	77	Go
63	idso-fa1-pathology/k8s-cluster-env Environment Configuration for Kubernetes Cluster Usage	29	Experimental	1	Dockerfile
64	combinator-ml/combinator Combinator.ml's central repo, documentation and website	29	Experimental	30	Makefile
65	heyfey/vodascheduler GPU scheduler for elastic/distributed deep learning workloads in Kubernetes...	29	Experimental	34	Go
66	ccheshirecat/volant Modular orchestration engine for microvms	28	Experimental	39	C
67	hyper-ml/hyperML Frictionless Machine Learning on Kubernetes	27	Experimental	15	Go
68	AICoE/prometheus-lts Store prometheus metrics with thanos	26	Experimental	8	Shell
69	mdzaheerjk/Kubernetes-Penetration-Testing-and-Benchmarking-with-KubeHunter-KubeBench This project tests an intentionally vulnerable MLOps ML app on a Minikube...	25	Experimental	7	—
70	myelintek/primehub-controller 🎮 PrimeHub Controller	23	Experimental	11	Go
71	MazenMoneim/Mastering-Kubernetes This repository contains comprehensive resources and code examples to help...	23	Experimental	4	—
72	MukundaKatta/DeployKit Deployment config generator — Docker Compose, Kubernetes, systemd, Nginx...	22	Experimental	—	Python
73	danielmaddaleno/azure-ml-pipeline Serverless ML inference pipeline on Azure Functions + Blob Storage	22	Experimental	—	Python
74	Kaamfjdm/kina 🚀 Run Kubernetes easily in Apple Containerization with kina, a quick...	22	Experimental	—	Shell
75	justin-oleary/straggler-shield Patent-pending K8s DaemonSet that validates GPU nodes via GEMM latency,...	21	Experimental	—	Go
76	Techn0logic/kubeflow-pipelines-standalone A Helm chart containing Kubeflow Pipelines as a standalone service.	20	Experimental	8	—
77	ankursoni/kubernetes-operator-roiergasias 'Roiergasias' kubernetes operator is meant to address a fundamental...	20	Experimental	7	Go
78	uhstray-io/open-k8s Easy kubernetes deployments and guides from uhstray.io	19	Experimental	4	Shell
79	spacejar-labs/spacejar-cli Build, pre-tain, finetune, deploy ML models with one command from your local...	17	Experimental	1	Shell
80	k3ai/k3ai.github.io K3ai is a lightweight tool to setup quickly an AI stack: K8s + AI platforms...	15	Experimental	—	JavaScript
81	idvoretskyi/linode-gpu-k8s Infrastructure as Code for deploying GPU-enabled Kubernetes clusters on...	15	Experimental	—	HCL
82	AzureLocal/azurelocal-ml-ai Machine learning and AI inference workloads on Azure Local — GPU VM...	14	Experimental	—	—
83	aayostem/riskoracle 🔘 Production ML platform — MLflow, Feast, Kubeflow, Delta Lake, Kubernetes,...	14	Experimental	—	Makefile
84	websterbei/SlakingML Slaking ML platform	11	Experimental	4	JavaScript
85	daovietanh190499/DeepOps Project for Automation Resource Managing	11	Experimental	3	JavaScript
86	mahshid1378/production-stack vLLM’s reference system for K8S-native cluster-wide deployment with...	11	Experimental	—	Python
87	xigang/groot A CLI for kubeflow.	11	Experimental	—	Go
88	bryanfree66/kubeflow-eks-demo Automating the machine learning workflow with KubeFlow on AWS EKS	11	Experimental	—	Go
89	LazaUK/AzureML-ServerlessEndpoint-Bicep Bicep template to deploy DeepSeek R1 model to a serverless (realtime)...	11	Experimental	—	Bicep
90	hadi-technology/vllm-mlops Performant LLM inferencing on Kubernetes via vLLM	11	Experimental	3	—

Comparisons in this category

kale and kubeflow (71 vs 55) kuberay and kubetorch (71 vs 62) kale and blog (71 vs 58)