mosecorg/mosec
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
This tool helps machine learning engineers and MLOps professionals efficiently deploy trained machine learning models as online services. It takes your existing ML model code and transforms it into a high-performance API that can handle many user requests simultaneously. The output is a robust, scalable web service ready for integration into applications.
893 stars. Used by 1 other package. Actively maintained with 6 commits in the last 30 days. Available on PyPI.
Use this if you need to serve machine learning models with high performance, dynamically batch requests to maximize hardware utilization (CPU/GPU), and deploy them reliably in a cloud environment.
Not ideal if you are looking for a tool to train or optimize your machine learning models, as this focuses solely on the serving aspect.
Stars
893
Forks
72
Language
Python
License
Apache-2.0
Category
Last pushed
Mar 01, 2026
Commits (30d)
6
Reverse dependents
1
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/mlops/mosecorg/mosec"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
jeremyarancio/VLM-Batch-Deployment
Batch Deployment for Document Parsing with AWS Batch & Qwen-2.5-VL
SemiAnalysisAI/InferenceX-app
Dashboard for InferenceX™, Open Source Continuous Inference
amanparuthi8/gpu-llm-india-2026
Should you buy a DGX Spark or rent H100s? Run on Mac Mini or TAALAS cluster? Full cost &...
DunaSpice/JetsonMind
Production-ready AI inference system for NVIDIA Jetson devices with MCP integration, Docker...