clearml/clearml-serving
ClearML - Model-Serving Orchestration and Repository Solution
This tool helps machine learning engineers and data scientists easily deploy their trained machine learning and deep learning models for real-world use. It takes your pre-trained models (like Scikit-learn, TensorFlow, PyTorch, or ONNX) and associated preprocessing/postprocessing code, and deploys them as a live service that can process new data requests. The result is a robust, scalable, and continuously available model serving endpoint.
161 stars. Available on PyPI.
Use this if you need to quickly and reliably get your machine learning models from training into production, handling ongoing predictions with features like auto-scaling and monitoring.
Not ideal if you are looking for a tool to train models or manage the entire machine learning experiment lifecycle, as this focuses specifically on the deployment phase.
Stars
161
Forks
51
Language
Python
License
Apache-2.0
Category
Last pushed
Mar 12, 2026
Commits (30d)
0
Dependencies
2
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/mlops/clearml/clearml-serving"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
feast-dev/feast
The Open Source Feature Store for AI/ML
lakehq/sail
LakeSail's computation framework with a mission to unify batch processing, stream processing,...
PaddlePaddle/Serving
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）
SeldonIO/MLServer
An inference server for your machine learning models, including support for multiple frameworks,...
sustainable-computing-io/kepler-model-server
Model Server for Kepler