garyfanhku/Galore-pytorch

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

18
/ 100
Experimental

This project helps machine learning engineers and researchers train very large language models more efficiently. It takes a large language model and training data as input, and produces a trained model while using significantly less memory. This allows for training models that would otherwise be too large for available hardware.

No commits in the last 6 months.

Use this if you are a machine learning practitioner struggling with out-of-memory errors when training large language models due to hardware limitations.

Not ideal if you are looking for a fully polished, production-ready library with comprehensive logging and real-world data training examples.

LLM-training deep-learning-optimization AI-model-development GPU-memory-management
No License Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 6 / 25
Maturity 8 / 25
Community 4 / 25

How are scores calculated?

Stars

22

Forks

1

Language

Python

License

Category

llm-fine-tuning

Last pushed

Mar 07, 2024

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/garyfanhku/Galore-pytorch"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.