couler-proj/couler
Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
This system helps machine learning engineers and data scientists build and manage complex ML workflows in the cloud more easily. It takes your ML pipeline code and generates optimized workflows for execution on systems like Argo Workflows, handling tasks like caching, parallelization, and hyperparameter tuning. The result is a streamlined, efficient, and standardized way to run your ML experiments and models.
943 stars. No commits in the last 6 months.
Use this if you are a machine learning engineer or data scientist struggling with the complexity and varying interfaces of different cloud workflow engines for your ML pipelines.
Not ideal if you need a solution that currently supports multiple workflow engines beyond Argo Workflows, or if you require full access to all features of a specific engine like Airflow.
Stars
943
Forks
88
Language
Python
License
Apache-2.0
Category
Last pushed
Oct 08, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/mlops/couler-proj/couler"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
mlrun/mlrun
MLRun is an open source MLOps platform for quickly building and managing continuous ML...
clearml/clearml
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data...
argoproj-labs/hera
Hera makes Python code easy to orchestrate on Argo Workflows through native Python integrations....
argoproj/argo-workflows
Workflow Engine for Kubernetes