albincorreya/ml-training-airflow-mlflow-example
An example of setting up local audio ML training pipeline on Airflow with MLFlow experiment tracking and custom python library.
This project provides an example of setting up a local machine learning operations (MLOps) pipeline for audio classification tasks. It takes raw audio data and configurations as input, processes it through a defined workflow, and outputs trained machine learning models along with tracked experiment results. This is ideal for data scientists who want to learn how to integrate open-source tools for managing ML training workflows.
No commits in the last 6 months.
Use this if you are a data scientist looking to understand and implement a local MLOps pipeline using open-source tools like Airflow and MLFlow for audio ML training.
Not ideal if you are looking for a production-ready cloud-based MLOps solution or a simple library for immediate use without infrastructure setup.
Stars
24
Forks
9
Language
Python
License
—
Category
Last pushed
Nov 18, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/mlops/albincorreya/ml-training-airflow-mlflow-example"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
mlrun/mlrun
MLRun is an open source MLOps platform for quickly building and managing continuous ML...
clearml/clearml
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data...
argoproj-labs/hera
Hera makes Python code easy to orchestrate on Argo Workflows through native Python integrations....
argoproj/argo-workflows
Workflow Engine for Kubernetes