georgian-io/LLM-Finetuning-Toolkit
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
This toolkit helps machine learning engineers and researchers quickly train open-source large language models (LLMs) for specific tasks. You provide your specialized dataset and a configuration file, and it fine-tunes the LLM and gives you the updated model weights and performance metrics. It's designed for individuals who need to adapt existing LLMs to unique use cases efficiently.
870 stars. No commits in the last 6 months.
Use this if you need to systematically fine-tune multiple open-source LLMs on your custom data, experiment with different training strategies, and evaluate their performance through automated tests.
Not ideal if you're looking to train a large language model from scratch or don't have access to your own labeled datasets for fine-tuning.
Stars
870
Forks
105
Language
Python
License
Apache-2.0
Category
Last pushed
Oct 25, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/georgian-io/LLM-Finetuning-Toolkit"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
OptimalScale/LMFlow
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
adithya-s-k/AI-Engineering.academy
Mastering Applied AI, One Concept at a Time
jax-ml/jax-llm-examples
Minimal yet performant LLM examples in pure JAX
young-geng/scalax
A simple library for scaling up JAX programs
riyanshibohra/TuneKit
Upload your data → Get a fine-tuned SLM. Free.