ethanluoyc/lxm3
LXM3: XManager launch backend for HPC clusters
This tool helps machine learning researchers and data scientists efficiently run their computational experiments on high-performance computing (HPC) clusters. You define your Python-based experiment and specify the cluster environment, and it packages your code into a Singularity container, deploying and executing it on SGE or Slurm-managed clusters. This is for researchers who need to run many large-scale experiments and want a streamlined way to manage dependencies and execution across different HPC systems.
No commits in the last 6 months. Available on PyPI.
Use this if you are a machine learning researcher or data scientist who regularly runs complex Python experiments on HPC clusters and wants to simplify experiment deployment and dependency management.
Not ideal if you primarily run small-scale computations locally or on cloud platforms, or if your projects don't require containerized environments on traditional HPC systems.
Stars
10
Forks
1
Language
Python
License
—
Category
Last pushed
May 11, 2024
Commits (30d)
0
Dependencies
14
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/mlops/ethanluoyc/lxm3"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
claimed-framework/mlx
Machine Learning eXchange (MLX). Data and AI Assets Catalog and Execution Engine
Dramwig/FlowLine
Automated tool for running Python programs in a streamlined manner
plynx-team/plynx
PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.