hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
This tool helps researchers, data scientists, and ML engineers customize large language models for specific tasks. You input an existing large language model and your own specialized dataset, and it outputs a fine-tuned model that performs better on your unique data or problem. It's designed for anyone who needs to adapt powerful AI models without deep programming.
68,347 stars. Actively maintained with 21 commits in the last 30 days.
Use this if you need to adapt a pre-trained large language model (LLM) or vision-language model (VLM) to perform a specific task, such as understanding proprietary documents, generating tailored marketing copy, or categorizing customer feedback.
Not ideal if you need to train a large language model entirely from scratch or if you primarily work with traditional machine learning models that are not transformer-based.
Stars
68,347
Forks
8,346
Language
Python
License
Apache-2.0
Category
Last pushed
Mar 10, 2026
Commits (30d)
21
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/hiyouga/LlamaFactory"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Recent Releases
Compare
Related models
unslothai/unsloth
Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama,...
huggingface/peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.5, DeepSeek-R1, GLM-5,...
oumi-ai/oumi
Easily fine-tune, evaluate and deploy gpt-oss, Qwen3, DeepSeek-R1, or any open source LLM / VLM!
linkedin/Liger-Kernel
Efficient Triton Kernels for LLM Training