mlcommons/cm4mlops
Legacy CM repository with a collection of portable, reusable and cross-platform CM automations for MLOps and MLPerf to simplify the process of building, benchmarking and optimizing AI systems across diverse models, data sets, software and hardware
This repository helps MLOps engineers, DevOps specialists, and AI system developers standardize and automate common machine learning workflows. It provides pre-built, modular scripts and caching mechanisms to manage tasks like Docker runs, benchmarking AI models (including MLPerf), and optimizing their performance across various hardware and software. You provide your models, datasets, and target infrastructure, and it helps you get consistent, reproducible results and performance metrics.
No commits in the last 6 months.
Use this if you need to automate the building, benchmarking, and optimization of AI systems, especially when working with diverse models, datasets, and hardware.
Not ideal if you are an end-user simply looking to use an existing AI application or if you prefer manual, ad-hoc execution of your ML tasks.
Stars
19
Forks
21
Language
Python
License
Apache-2.0
Category
Last pushed
Mar 13, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/mlops/mlcommons/cm4mlops"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
mlrun/mlrun
MLRun is an open source MLOps platform for quickly building and managing continuous ML...
clearml/clearml
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data...
argoproj-labs/hera
Hera makes Python code easy to orchestrate on Argo Workflows through native Python integrations....
argoproj/argo-workflows
Workflow Engine for Kubernetes