Kubernetes ML Deployment ML Frameworks

Tools and platforms for deploying, orchestrating, and managing machine learning workloads on Kubernetes clusters. Includes infrastructure-as-code, operators, and integrated stacks combining ML frameworks with K8s. Does NOT include general Kubernetes management tools, standalone ML frameworks, or non-containerized deployment solutions.

There are 24 kubernetes ml deployment frameworks tracked. 2 score above 50 (established tier). The highest-rated is muna-ai/muna-py at 54/100 with 84 stars.

Get all 24 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=kubernetes-ml-deployment&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	muna-ai/muna-py Run AI models anywhere. https://muna.ai/explore	54	Established	84	Python
2	clearml/clearml-pycharm-plugin ClearML PyCharm Plugin	51	Established	36	Java
3	sql-machine-learning/elasticdl Kubernetes-native Deep Learning Framework	48	Emerging	746	Python
4	microsoft/AKSDeploymentTutorial Tutorial on how to deploy Deep Learning models on GPU enabled Kubernetes cluster	47	Emerging	77	Jupyter Notebook
5	Langhalsdino/Kubernetes-GPU-Guide This guide should help fellow researchers and hobbyists to easily automate...	47	Emerging	816	Shell
6	tamohannes/urartu Build ML pipelines with smart caching and remote execution. Develop locally,...	45	Emerging	13	Python
7	cognizant-ai-lab/studio-go-runner ML/ENN Runner for privately hosted, cloud, and data-center production...	41	Emerging	2	Go
8	Datura-ai/lium Rent ready-to-use cloud GPUs in seconds. Lium CLI makes it easy to launch,...	41	Emerging	5	Python
9	KAMONOHASHI/kamonohashi AI開発プラットフォームKAMONOHASHI	40	Emerging	86	C#
10	Kretski/ScalePredict Run a 2-min local benchmark → predict how long your AI job will take on...	39	Emerging	3	Python
11	Alluxio/k8s-operator An operator for managing Alluxio system on Kubernetes cluster	38	Emerging	13	Go
12	radheshpai87/checkDK checkDK — AI-powered Docker Compose & Kubernetes config validator. Catch...	35	Emerging	6	Python
13	aws-samples/ecs-gpu-scaling Amazon ECS Auto Scaling for GPU-based Machine Learning Workloads	35	Emerging	17	TypeScript
14	dlops-io/dlops Open source platform for the deep learning development lifecycle	33	Emerging	3	Dockerfile
15	devopscorner/nifi Production Grade Nifi & Nifi Registry. Deploy for VM (Virtual Machine) with...	31	Emerging	13	Python
16	simonaco/serverless-cognitive-services Serverless endpoints calling Cognitive Services APIs	29	Experimental	15	JavaScript
17	btcgetpro/oci-plugin-example 🌐 Enhance your Volant microVMs with this official Nginx plugin, providing...	27	Experimental	1	—
18	esdras01-droid/gokart 🛠️ Simplify your Go service setup with GoKart, a toolkit that streamlines...	21	Experimental	—	Go
19	alice-viola/dora An all-in-one solution for training, testing and maintaining your AI based software	20	Experimental	5	JavaScript
20	Roll4d4/KLEP KLEP (Key-Lock-Executable-Process) is a groundbreaking AI framework that...	20	Experimental	5	C#
21	asklokesh/k8s-gpu-workload-enhancer Intelligent GPU Resource Management Platform for Kubernetes - Topology-aware...	17	Experimental	—	Go
22	scttfrdmn/conduit AWS-native platform for publishing, discovering, and deploying scientific ML models	17	Experimental	—	Go
23	SoeldnerConsult/kubeflow-extensions This project hooks into Kubeflow processes increasing usability for on-prem usage	11	Experimental	—	Java
24	mjtechguy/do-gpu-terraform Terraform code to deploy and configure a DigitalOcean GPU node	11	Experimental	—	HCL