ML API Deployment ML Frameworks

Tools and frameworks for deploying trained machine learning models as production-ready APIs with containerization, serving infrastructure, and best practices. Includes FastAPI/Flask services, Docker packaging, and inference optimization. Does NOT include model training, data preparation, or general cloud deployment guidelines without ML-specific serving patterns.

There are 31 ml api deployment frameworks tracked. 3 score above 50 (established tier). The highest-rated is eightBEC/fastapi-ml-skeleton at 54/100 with 600 stars.

Get all 31 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=ml-api-deployment&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	eightBEC/fastapi-ml-skeleton FastAPI Skeleton App to serve machine learning models production-ready.	54	Established	600	Python
2	satellite-image-deep-learning/model-training-and-deployment Training and deployment of deep learning models for satellite & aerial imagery	53	Established	67	—
3	MarwanDebbiche/post-tuto-deployment Build and deploy a machine learning app from scratch 🚀	50	Established	393	Python
4	BolajiAyodeji/deploy-ml-web-workshop In this workshop, you will learn how to build a machine learning model using...	47	Emerging	23	Jupyter Notebook
5	codingforentrepreneurs/AI-as-an-API Learn to create & deploy a deep learning algorithm into a production REST...	46	Emerging	76	Jupyter Notebook
6	kingabzpro/FastAPI-for-ML Building a simple FastAPI application for model inference.	43	Emerging	65	Python
7	DanilBaibak/real-time-ml-prediction Build a production ready Machine Learning service for real-time prediction...	41	Emerging	35	Python
8	wahyudesu/Fastapi-AI-Production-Template Simple starter template for your ML/AI projects (uv package manager, RestAPI...	41	Emerging	94	Jupyter Notebook
9	MDalamin5/FastAPI-for-Machine-Learning-and-Agentic-Ai A practical FastAPI-based repository for building and deploying APIs,...	39	Emerging	3	Python
10	kingabzpro/Stress-Testing-FastAPI Build a FastAPI web application and perform stress testing using Locust.	36	Emerging	6	HTML
11	mlexpertio/ml-project-template Starter template for your ML/AI projects (uv package manager, RestAPI with...	36	Emerging	33	Python
12	khanh41/fastapi-mongodb-base-project This is base code of fastapi, mongodb and machine learning with poetry env	36	Emerging	13	Python
13	twilio-labs/ml-training-api A service template for asynchronous machine learning model training	34	Emerging	18	Python
14	dnguyenngoc/ml-models-in-production This repo gives an introduction to how to make full working example to serve...	33	Emerging	30	Python
15	atick-faisal/Deep-Learning-Cloud-Run-Starter Starter Code for Deploying an Machine Learning App to the Google Cloud Run	33	Emerging	3	Jupyter Notebook
16	haicheviet/fullstack-machine-learning-inference Fullstack machine learning inference template	33	Emerging	31	Jupyter Notebook
17	Hoopoes/FastStart A modular and flexible starter kit for FastAPI projects, featuring branches...	32	Emerging	34	—
18	anshupandey/Deploy_Machine_Learning_Projects This repository contains the examples of deploying AI, ML models using...	28	Experimental	10	Jupyter Notebook
19	ejhusom/d2m A machine learning pipeline taking you from raw data to fully trained...	28	Experimental	8	Python
20	kingabzpro/Redis-ml-project Model serving with FastAPI and Redis caching to enable fast and efficient...	26	Experimental	9	Python
21	trydoff/ML-Portal-FastAPI A complete end-to-end machine learning portal that covers processes starting...	26	Experimental	42	Python
22	SteliosGian/fastapi-celery-redis-flower A FastAPI application with Redis, Celery, and Flower	25	Experimental	11	Python
23	riadh565/beta-binomial-classifier-api 📊 Build and deploy a beta-binomial classifier API using FastAPI and Docker...	22	Experimental	—	Jupyter Notebook
24	nateraw/lambdacloud An unofficial Python client library for Lambda Lab's Cloud Computing Platform	22	Experimental	12	Python
25	Kimosabey/auto-etl Enterprise auto-etl Technical Architecture focusing on Scalability and High...	21	Experimental	—	—
26	ArjunPramod/realtime-ai-backend Realtime AI backend with WebSockets, LLM streaming, and Supabase.	17	Experimental	—	Python
27	shreypatel2311/CRUD-and-FastAPI Order Management API	16	Experimental	4	Python
28	swarali-more/python-backend-ml Python Backend + ML learning journey	14	Experimental	—	Python
29	Deep-Mux/TransGAN A quick guide on how to deploy TransGAN network on the cloud	14	Experimental	15	Python
30	Sandip-2001/multi-model-ai-api A highly scalable FastAPI gateway routing unified JSON requests to isolated...	14	Experimental	—	Python
31	Ares-Infenus/penguin-ml-api Production-ready ML API built with FastAPI and scikit-learn, featuring a...	14	Experimental	—	Python

Comparisons in this category

fastapi-ml-skeleton and FastAPI-for-ML (54 vs 43) Fastapi-AI-Production-Template and ml-project-template (41 vs 36)