maharshi95/submititnow
A toolkit to create, launch and monitor SLURM jobs over existing python scripts.
This toolkit helps researchers, data scientists, and engineers run their Python scripts efficiently on computing clusters managed by SLURM. It takes your existing Python script and parameters, then automates the process of launching multiple jobs with varying configurations, often for large-scale experiments. You get a simple way to monitor the status and output of all these jobs.
No commits in the last 6 months. Available on PyPI.
Use this if you frequently run Python scripts on a SLURM cluster and need an easier way to launch, manage, and monitor many jobs, especially when testing different configurations or hyperparameters.
Not ideal if you don't use SLURM for job scheduling or if your Python scripts are not designed with an `argparse` based `main` function.
Stars
12
Forks
2
Language
Python
License
MIT
Category
Last pushed
May 13, 2024
Commits (30d)
0
Dependencies
7
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/mlops/maharshi95/submititnow"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
1minds3t/omnipkg
Universal Python Runtime Orchestrator - One environment. Infinite Pythons and packages. <1ms...
bigscience-workshop/bigscience
Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute...
LthreeC/pyruns
A lightweight Python CLI for batch experiments: auto-generate tasks from configs, run in...
synpse-hq/slurm-cluster
A quick and automated way to setup your Slurm mini cluster