LoRA QLoRA Fine-tuning Transformer Models

Tools and frameworks for parameter-efficient fine-tuning of LLMs using LoRA, QLoRA, and related subspace tuning methods on consumer hardware. Does NOT include general fine-tuning without these specific techniques, model compression, or task-specific applications unless they primarily demonstrate these adaptation methods.

There are 230 lora qlora fine-tuning models tracked. 5 score above 70 (verified tier). The highest-rated is unslothai/unsloth at 81/100 with 53,879 stars. 7 of the top 10 are actively maintained.

Get all 230 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=lora-qlora-fine-tuning&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	unslothai/unsloth Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss,...	81	Verified	53,879	Python
2	huggingface/peft 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.	80	Verified	20,777	Python
3	modelscope/ms-swift Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.5,...	78	Verified	13,105	Python
4	oumi-ai/oumi Easily fine-tune, evaluate and deploy gpt-oss, Qwen3, DeepSeek-R1, or any...	77	Verified	8,907	Python
5	linkedin/Liger-Kernel Efficient Triton Kernels for LLM Training	77	Verified	6,206	Python
6	hiyouga/LlamaFactory Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)	67	Established	68,347	Python
7	stochasticai/xTuring Build, personalize and control your own LLMs. From data pre-processing to...	64	Established	2,668	Python
8	h2oai/h2o-llmstudio H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs....	63	Established	4,897	Python
9	dvgodoy/FineTuningLLMs Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with...	57	Established	786	Jupyter Notebook
10	roboflow/maestro streamline the fine-tuning process for multimodal models: PaliGemma 2,...	55	Established	2,661	Python
11	TUDB-Labs/mLoRA An Efficient "Factory" to Build Multiple LoRA Adapters	48	Emerging	373	Python
12	mallorbc/Finetune_LLMs Repo for fine-tuning Casual LLMs	48	Emerging	458	Python
13	predibase/lorax Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs	47	Emerging	3,735	Python
14	Chongjie-Si/Subspace-Tuning A generalized framework for subspace tuning methods in parameter efficient...	46	Emerging	177	Python
15	ashishpatel26/LLM-Finetuning LLM Finetuning with peft	45	Emerging	2,827	Jupyter Notebook
16	Bavest/fin-llama LLAMA specialized on finance	45	Emerging	146	Jupyter Notebook
17	lxe/simple-llm-finetuner Simple UI for LLM Model Finetuning	44	Emerging	2,062	Jupyter Notebook
18	jianzhnie/LLamaTuner Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen,...	44	Emerging	620	Python
19	kamalkraj/e5-mistral-7b-instruct Finetune mistral-7b-instruct for sentence embeddings	44	Emerging	88	Python
20	GAIR-NLP/MegaScience MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoning	43	Emerging	113	Python
21	jasonvanf/llama-trl LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA	43	Emerging	238	Python
22	AviSoori1x/Tuning-the-Finetuning Tuning the Finetuning: An exploration of achieving success with QLoRA	43	Emerging	46	Python
23	ethicalabs-ai/kurtis Kurtis is a fine-tuning, inference and evaluation tool built for SLMs (Small...	43	Emerging	6	Python
24	ruimalheiro/training-custom-llama Llama-style transformer in PyTorch with multi-node / multi-GPU training....	43	Emerging	21	Python
25	ssbuild/deep_training deep learning	42	Emerging	151	Python
26	zetavg/LLaMA-LoRA-Tuner UI tool for fine-tuning and testing your own LoRA models base on LLaMA,...	42	Emerging	476	Python
27	Gunale0926/SORSA SORSA: Singular Values and Orthonormal Regularized Singular Vectors...	42	Emerging	38	Python
28	leehanchung/lora-instruct Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA	42	Emerging	104	Python
29	okuvshynov/slowllama Finetune llama2-70b and codellama on MacBook Air without quantization	41	Emerging	450	Python
30	Guitaricet/relora Official code for ReLoRA from the paper Stack More Layers Differently:...	41	Emerging	474	Jupyter Notebook
31	Beomi/Gemma-EasyLM Train GEMMA on TPU/GPU! (Codebase for training Gemma-Ko Series)	41	Emerging	48	Python
32	princeton-nlp/LESS [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning	41	Emerging	514	Jupyter Notebook
33	wuwangzhang1216/prometheus Fully automatic censorship removal for language models. LoRA abliteration +...	40	Emerging	33	Python
34	google-deepmind/gemma_penzai A JAX Research Toolkit for Visualizing, Manipulating, and Understanding...	40	Emerging	90	Jupyter Notebook
35	git-cloner/llama-lora-fine-tuning llama fine-tuning with lora	40	Emerging	140	Python
36	Shannon-Labs/shannon-control-unit Shannon Control Unit: Adaptive regularization via control theory for LLM training	39	Emerging	6	Python
37	misonsky/HiFT memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B	39	Emerging	21	Python
38	shrut2702/upasak UI-based Fine-Tuning for Large Language Models (LLMs)	39	Emerging	20	Python
39	MURUGESAN88709/mental-health-finetuned-llama 🧠 Fine-tune LLaMA for mental health applications, providing insights and...	39	Emerging	1	Python
40	GAIR-NLP/OctoThinker Revisiting Mid-training in the Era of Reinforcement Learning Scaling	39	Emerging	185	Jupyter Notebook
41	ariG23498/gemma3-object-detection Fine tune Gemma 3 on an object detection task	39	Emerging	100	Python
42	deep-div/Fine-Tuning-LLMs-and-VisionModels Fine-Tuning LLMs (Gemma, LLaMA, Mistral, etc.) A practical guide to...	38	Emerging	17	Jupyter Notebook
43	minosvasilias/godot-dodo Finetuning large language models for GDScript generation.	38	Emerging	567	Python
44	NisaarAgharia/Indian-LawyerGPT Fine-Tuning Falcon-7B, LLAMA 2 with QLoRA to create an advanced AI model...	38	Emerging	93	Jupyter Notebook
45	muhammad-fiaz/finetune-web-ui Finetune Web UI is a user-interface for training and deploying pre-trained models.	37	Emerging	12	Python
46	benitomartin/food-images-finetuning Fine-tuning of LiquidAI LFM2-VL vision-language models on food image...	37	Emerging	7	Jupyter Notebook
47	YassWorks/Tuna Python library that makes fine-tuning transformer-based models easier and faster.	37	Emerging	5	Python
48	poteminr/instruct-ner Instruct LLMs for flat and nested NER. Fine-tuning Llama and Mistral models...	37	Emerging	89	Python
49	avocardio/Zicklein Finetuning instruct-LLaMA on german datasets.	36	Emerging	33	Python
50	frankluise5220/ComfyUI-Lorahelper A professional automation toolkit for ComfyUI to prepare LoRA training data...	35	Emerging	10	Python
51	jorgemunozl/Finetunning-Llama-Vision-11b Inference and finnetunning of a VLM (LLama Vision 11b) using the Unsloth,...	34	Emerging	9	Python
52	michaelnny/QLoRA-LLM A simple custom QLoRA implementation for fine-tuning a language model (LLM)...	34	Emerging	10	Python
53	adithya-s-k/CompanionLLM CompanionLLM - A framework to finetune LLMs to be your own sentient...	33	Emerging	50	Jupyter Notebook
54	rabiloo/llm-finetuning Sample for Fine-Tuning LLMs & VLMs	33	Emerging	2	Python
55	UCDvision/NOLA Code for NOLA, an implementation of "nola: Compressing LoRA using Linear...	33	Emerging	57	Python
56	monk1337/NanoPeft The simplest repository & Neat implementation of different Lora methods for...	33	Emerging	7	Jupyter Notebook
57	srsawant34/efficient_instruction_learning Code base for the paper "Instruction Tuned Models are Quick Learners".	33	Emerging	5	Python
58	babycommando/neuralgraffiti Live-bending a foundation model’s output at neural network level.	32	Emerging	273	Jupyter Notebook
59	Simplifine-gamedev/Simplifine 🚀 Easy, open-source LLM finetuning with one-line commands, seamless cloud...	32	Emerging	96	Python
60	MaxwellYaoNi/PACE [NeurIPS 2024 Spotlight] Official implementation for "PACE: marrying...	32	Emerging	18	Python
61	Joyce94/LLM-RLHF-Tuning LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)	31	Emerging	453	Python
62	ssbuild/llm_finetuning Large language Model fintuning bloom , opt , gpt, gpt2...	30	Emerging	100	Python
63	EvilFreelancer/MoDA Is a framework designed to enhance the performance and flexibility of large...	30	Emerging	2	Jupyter Notebook
64	yunkai1841/recipe-generation NLP Text generation task. Generate recipe by fine tuned LLaMA model.	30	Emerging	2	Python
65	calhounpaul/LLaMA-PEFT-LoRa-subreddit-chatbot-colab Parameter Efficient Fine Tuning (PEFT) to create a chatbot from Facebook's...	30	Emerging	6	Jupyter Notebook
66	fshnkarimi/Fine-tuning-an-LLM-using-LoRA 📚 Text Classification with LoRA (Low-Rank Adaptation) of Language Models -...	30	Emerging	55	Jupyter Notebook
67	CoffeeVampir3/ez-trainer Train Llama Loras Easily	29	Experimental	31	Python
68	awilliamson10/clipora Clipora is a powerful toolkit for fine-tuning OpenCLIP models using Low Rank...	29	Experimental	24	Python
69	gmongaras/Wizard_QLoRA_Finetuning Finetuning Some Wizard Models With QLoRA	29	Experimental	7	Python
70	Cyr-Ch/lora-qlora-101 Parameter-efficient fine-tuning toolkit for LLMs using LoRA and QLoRA....	29	Experimental	4	Jupyter Notebook
71	HemantBK/LLaMA-Sum-Fine-Tuning Fine-tuned Meta's LLaMA 3.2 1B for text summarization using QLoRA (4-bit...	28	Experimental	3	Python
72	LegendLeoChen/llm-finetune 使用trl、peft、transformers等库，实现对huggingface上模型的微调。	28	Experimental	10	Python
73	Beomi/easy-lm-trainer 🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드	28	Experimental	59	Python
74	Cre4T3Tiv3/unsloth-llama3-alpaca-lora Advanced 4-bit QLoRA fine-tuning pipeline for LLaMA 3 8B with...	28	Experimental	33	Jupyter Notebook
75	plutonium-239/memsave_torch Lowering PyTorch's Memory Consumption for Selective Differentiation	27	Experimental	12	Python
76	AbineshSivakumar/Llama-2-7B-QLoRA-Vicuna This repository contains code to fine-tune a Llama-7B-Uncensored model using...	27	Experimental	8	Python
77	ArchitJ6/Llama2-FineTuning 🦙 Llama2-FineTuning: Fine-tune LLAMA 2 with Custom Datasets Using LoRA and...	27	Experimental	1	Jupyter Notebook
78	Miraclemarvel55/LLaMA-MOSS-RLHF-LoRA 用RLHF可选LoRA对LLaMA和MOSS进行训练\|Training LLaMA or MOSS with RLHF [LoRA]	26	Experimental	21	Python
79	illoonego/gemma-finetune-emails LoRA fine-tuning pipeline for Google’s Gemma-2B language model to classify...	26	Experimental	1	Python
80	RangiLyu/llama.mmengine Training LLaMA language model with MMEngine! It supports LoRA fine-tuning!	26	Experimental	40	Python
81	Jiacheng-Zhu-AIML/AsymmetryLoRA Preprint: Asymmetry in Low-Rank Adapters of Foundation Models	25	Experimental	38	Python
82	DrRuin/Lightweight-Fine-Tuning Lightweight fine-tuning is one of the most important techniques for adapting...	25	Experimental	5	Jupyter Notebook
83	yuki-2025/llama3-8b-fine-tuning-math Fine-Tuning Llama 3-8B for Structured Math Reasoning: Fine-tuning Llama3 8b...	25	Experimental	4	Python
84	PRITHIVSAKTHIUR/Qwen-Image-LoRA-DLC Qwen-Image model with various LoRA (Low-Rank Adaptation) styles. This tool...	24	Experimental	4	Python
85	Nutanpatil06/Fine-Tuning-LLM-with-LLaMA-Factory Complete LoRA/QLoRA implementation using LLaMA Factory. Fine-tune models...	24	Experimental	1	Jupyter Notebook
86	opencodeiiita/Finetuning_Llama Fine-Tuning LLaMA for Indian Laws	24	Experimental	2	Jupyter Notebook
87	Josephrp/SmolFactory finetune gpt-oss and smollm3 on your data easily and cheaply	24	Experimental	2	Python
88	mirzayasirabdullahbaig07/Fine-Tuning-LLaMA-3.2-3B-Using-PEFT-LoRA This project showcases parameter-efficient fine-tuning of the LLaMA 3.2 (3B)...	24	Experimental	18	Jupyter Notebook
89	Md-Emon-Hasan/Fine-Tuning End-to-end fine-tuning of Hugging Face models using LoRA, QLoRA,...	23	Experimental	1	Jupyter Notebook
90	viktor-shcherb/llm-tool-call-sft LoRA fine-tuning pipeline for tool-calling chat LLMs with config-driven...	23	Experimental	5	Python
91	ethicalabs-ai/FlowerTune-Qwen2.5-Coder-0.5B-Instruct FlowerTune LLM on Coding Dataset	23	Experimental	3	Python
92	MakazhanAlpamys/Soup Soup turns the pain of LLM fine-tuning into a simple workflow. One config,...	23	Experimental	2	Python
93	nakjun/Llama-3.2-1B-Instruct-KorQuAD-Finetune Llama-3.2-1B-Instruct model and KorQuAD dataset Finetune project	22	Experimental	2	Python
94	Kentakoong/optimize-finetuning-llm A repository where we Optimize the Fine-tuning process of LLMs in LANTA	22	Experimental	2	Python
95	MarinaComotti/Finance_Specialist_AI Fine-Tuning Llama 3 for Financial Question-Answering	22	Experimental	2	Jupyter Notebook
96	sandeeppanem/qwen3-resume-extraction Fine-tune Qwen3-0.6B for resume parsing using LoRA	22	Experimental	1	Python
97	AswaniSahoo/llama-task-agent Fine-tuned LLaMA-3.1-8B task agent with LoRA for reliable tool execution	22	Experimental	1	Jupyter Notebook
98	NamelyCorp/NamelyCorp-LLM-Studio Local-first LoRA fine-tuning studio with web UI for document-grounded LLM training.	22	Experimental	1	Python
99	mamounyosef/commit-message-llm Fine-tuning Qwen2.5-Coder-0.5B LLM using QLoRA (4-bit quantization + LoRA)...	22	Experimental	1	Python
100	xHarshit/Self-Healing-Classification-DAG-with-Fine-Tuned-Model A self-healing text classification pipeline built with LangGraph and a...	22	Experimental	1	Python
101	matteo-stat/transformers-llm-llama3.1-fine-tuning-qlora This repo offers scripts for fine-tuning LLaMA 3.1 models with QLoRA,...	22	Experimental	2	Python
102	benitomartin/peft-gemma-2b Fine Tuning Gemma 2B	22	Experimental	2	Jupyter Notebook
103	Geenukaneco/NamelyCorp-LLM-Studio 📄 Build document-grounded language models with ease using NamelyCorp LLM...	22	Experimental	—	Python
104	Thariya13/medical-llm-lora 🧠 Fine-tuning a medical reasoning LLM with LoRA 🚀 — Step-by-step project to...	22	Experimental	1	Jupyter Notebook
105	kossisoroyce/Gemma-3n-local-training A lightweight, GPU-focused framework to run inference and LoRA fine-tuning...	22	Experimental	7	Python
106	artryazanov/nitrogen-finetuner This project implements a Universal Fine-Tuning Pipeline for the NVIDIA...	22	Experimental	4	Python
107	dasdristanta13/LLM-Lora-PEFT_accumulate LLM-Lora-PEFT_accumulate explores optimizations for Large Language Models...	22	Experimental	6	Jupyter Notebook
108	aman-17/MediSOAP FineTuning LLMs on conversational medical dataset.	22	Experimental	6	Jupyter Notebook
109	rizalsimb1/ml-monitoring Fine-tune large language models (Llama 3, Mistral, Phi-3) with LoRA and...	21	Experimental	—	Python
110	PRITHIVSAKTHIUR/Qwen-Image-Edit-2511-LoRAs-Fast-Single-Image-Rerun Experimental demonstration for the Qwen/Qwen-Image-Edit-2511 model with...	21	Experimental	2	Python
111	shuhulx/FineTuneCheck Diagnostic tool for LLM fine-tuning — automated forgetting detection,...	21	Experimental	—	Python
112	Abhijeet-ist/FineTunning This is a short script based on fine tuning a open sourced LLM based on...	21	Experimental	8	Jupyter Notebook
113	zachdwight/lora-model-builder-for-AI-chef Fine-tune any Hugging Face LLM on your own recipe dataset using LoRA + 4-bit...	21	Experimental	—	Python
114	min234/se_game LLaMA fine-tuned AI — YouTube script generator & code review assistant	21	Experimental	—	Python
115	BUAADreamer/MLLM-Finetuning-Demo 使用LLaMA-Factory微调多模态大语言模型的示例代码 Demo of Finetuning Multimodal LLM with LLaMA-Factory	21	Experimental	56	Python
116	ducnh279/LLMs-for-Text-Classification Fine-tuning Large Language Models (LLMs) for Text Classification Task	21	Experimental	35	Jupyter Notebook
117	GeiserX/epub-and-vtt-to-llm Given .epub and .vtt files, train and infere a new LLM	21	Experimental	—	Python
118	alexsuw/easylora Batteries-included toolkit for LoRA / QLoRA fine-tuning with Hugging Face...	21	Experimental	—	Python
119	Saeed-Mahmoud/lora-peft-customer-support-chatbot Parameter-efficient fine-tuning (LoRA/PEFT) for a customer support chatbot...	21	Experimental	—	Jupyter Notebook
120	harshitdhar9/gemma_peft_finetuned Fine-tuning gemma model using peft techniques	21	Experimental	—	Python
121	LoicSERRE/mistral-qlora-decp Fine-tuning Mistral 7B v0.3 avec QLoRA sur données publiques territoriales...	21	Experimental	—	Python
122	videogramme/Qwen-Image-Edit-2511-LoRAs-Fast-Single-Image-Rerun 🖼️ Edit images swiftly with the Qwen-Image-Edit-2511 model, featuring...	21	Experimental	—	PHP
123	danloi2/laesla-llm laesla-LLM is a Fine-tunes Meta NLLB-200 with MASSIVE DATASETS (OPUS Bible +...	21	Experimental	—	Jupyter Notebook
124	keresifon/igbo-model-training Igbo-English translation model training using AWS SageMaker. Fine-tuned...	21	Experimental	—	Jupyter Notebook
125	MahmoudAbusaqer/LLMs-Lora-Finetuning-vs-Zeroshot-Classification Official implementation comparing parameter-efficient LoRA fine-tuning...	21	Experimental	—	Python
126	A-SHOJAEI/MoLE-LoRA MoLE: Mixture of LoRA Experts - Parameter-efficient mixture-of-experts using...	21	Experimental	—	Jupyter Notebook
127	lionajuanabel/Fine-Dllm LoRA fine-tuning pipeline for tool-calling chat LLMs with config-driven...	21	Experimental	—	Python
128	Muhammad-Hammad-59/Qwen05B-lora-qlora-finetuning-for-customer-support Parameter-efficient fine-tuning (LoRA + QLoRA) of Qwen2.5-0.5B-Instruct for...	21	Experimental	—	Jupyter Notebook
129	kantkrishan0206-crypto/LoRAForge- Build a production‑grade, modular pipeline for fine‑tuning large language...	20	Experimental	1	—
130	ShadowMonarchX/Finetuning-LLM-main A practical repo for fine-tuning LLMs using QLoRA, PEFT, and other efficient...	20	Experimental	1	Jupyter Notebook
131	mazurkin/ptn train own virtual "PTN" LLM model	20	Experimental	1	Python
132	Spectrewolf8/PHi-3-SQL-generation-fine-tune-experiment A fine-tuned version of Phi-3-mini-4k-instruct for generating SQL queries...	20	Experimental	8	Jupyter Notebook
133	Ashish-kharde1/Micro-Reasoner-Qwen Lightweight reasoning-capable LLM built on Qwen3-4B using LoRA and 4-bit inference	20	Experimental	1	Jupyter Notebook
134	pramodkoujalagi/SmolLM2-360M-Instruct-Text-2-JSON A fine-tuned version of SmolLM2-360M-Instruct-bnb-4bit specialized for...	20	Experimental	4	Python
135	Pavansomisetty21/Qwen2-Vision-Finetuning-Unsloth---Maths-OCR-Formulae-Extraction- we finetune unsloth llama model to extract mathematical fomulas in the...	19	Experimental	4	Jupyter Notebook
136	Shengwei-Peng/Classical-Chinese-Translation A project for bidirectional translation between Classical Chinese and modern...	19	Experimental	3	Python
137	lucaslingle/e-lra Streamlined variant of Long-Range Arena with pinned dependencies, automated...	19	Experimental	4	Python
138	Logisx/LLMath-QLoRA 🧮 End-to-end LLM instruction finetuning based on PEFT & QLoRA to solve math problems.	19	Experimental	3	Jupyter Notebook
139	arham-kk/llama2-qlora-sft This model is a fine-tuned model based on the...	19	Experimental	3	—
140	Raxephion/loRA-Epoch-Analyser A Python script to analyze images generated at different epochs of LoRA...	19	Experimental	2	Python
141	ethicalabs-ai/BlossomTuneLLM Federated Supervised Fine-Tuning for Small Language Models (SLMs)	19	Experimental	2	Python
142	ankraj1234/MediGuide Comparing QLoRA, Prompt & Prefix Tuning on Mistral-7B for medical...	19	Experimental	1	Jupyter Notebook
143	Pavansomisetty21/LlamaNLP-Unsloth-Next-Gen-Text-Processing-with-Llama-and-Unsloth In this we generate NER ,Question Answering and text generation using...	18	Experimental	2	Jupyter Notebook
144	doem97/ICLR26_mtLoRA [ICLR 2026] Official implementation (Claude Agent reproduce supported) of...	18	Experimental	12	Python
145	Pavansomisetty21/Finetune-llama-model-for-Text-Generation-using-unsloth In this we finetune Llama-3.2-3B-Instruct model for text generation using unsloth	18	Experimental	2	Jupyter Notebook
146	Souptik96/efficient-domain-tuning Research paper on efficient fine tuning of small sized open source models...	18	Experimental	1	—
147	arjunravi26/mental-health-finetuned-llama A LLM(llama) finetuned for work well with mental health assistance	18	Experimental	1	Python
148	Vitgracer/LLM-lab LLM research lab: exploring fine-tuning, base models, architectures and more	18	Experimental	1	—
149	prasanna00019/Fine-Tuning-LLMs Fine-tuning GPT-2 and other models on tasks like classification, translation...	18	Experimental	1	Jupyter Notebook
150	Seanaaa0/QT-R1 STaR × S1 math pipeline on Qwen2.5-1.5B. LoRA, strict Final: format, ~20–30%...	18	Experimental	1	Python
151	makr-code/VCC-Clara Clara AI System - Machine learning with continuous training, multi-GPU...	17	Experimental	—	Python
152	FlosMume/LLAMA-qLoRA-Unsloth-Starter Fine-tuning Llama models with QLoRA using Unsloth for supervised instruction tasks	17	Experimental	—	Python
153	North-Shore-AI/hf_peft_ex Elixir port of HuggingFace's PEFT (Parameter-Efficient Fine-Tuning) library....	17	Experimental	—	Jupyter Notebook
154	gsmoon97/llm-semantic-understanding A comprehensive framework for fine-tuning and evaluating Large Language...	17	Experimental	—	Python
155	rplacucci/PEFT PyTorch implementation of the most common Parameter Efficient Fine-Tuning...	17	Experimental	—	Python
156	dean-brown1/sb_poc_V4 SchemaBank: 3x improvement over LoRA via sparse routing as training...	17	Experimental	—	Python
157	hasanhalacli/llama-3.2-finetuning Fine-tune Llama 3.2 with QLoRA - memory-efficient training, Alpaca/ShareGPT...	17	Experimental	—	Python
158	yuchengml/Adaptation-Tuning-PEFT Comparison of different adaptation methods on PEFT for fine-tuning...	17	Experimental	1	Python
159	sunil-dhaka/finetuning-llms an exercise in finetuning pythia suites of open source models for...	17	Experimental	1	Python
160	green5321/efficient_tuning_llms_python This is the repo for the Efficient Finetuning of Quantized LLMs project,...	17	Experimental	1	Python
161	sagarvk24/Fine-Tune-LLMs- This repository contains comprehensive notebooks, made by me, explaining how...	17	Experimental	1	Jupyter Notebook
162	alenzenx/WindowsEasyFinetuneLLM Finetune LLM using Torchtune on Windows	17	Experimental	1	Python
163	hubertik1/emotion-prediction-finetuning Fine-tune Qwen2.5-VL-7B with LoRA to predict human-rated emotion intensity...	16	Experimental	1	Python
164	Franekskc/gemma3-qa-finetuning Comparing Full Fine-Tuning, LoRA, and Layer Freezing for extractive QA on...	16	Experimental	1	Python
165	Samarth2001/LLM-Fine-tuning Parameter-efficient fine-tuning experiments for 7B LLMs on consumer...	15	Experimental	—	Jupyter Notebook
166	murapadev/Phinetuning A repository dedicated to finetuning phi2 models using advanced machine...	15	Experimental	7	Python
167	quocnhut134/Finetuning-LLM-Model-for-Intent-Classification-in-Banking Fine-tuning Large Language Models (LLMs) for precise customer intent...	15	Experimental	2	Jupyter Notebook
168	edersoncorbari/fine-tune-llm Demonstrate how to fine-tune a pre-trained LLM	15	Experimental	—	Jupyter Notebook
169	krishnakoushik225/ecg-peft-benchmark Benchmarking PEFT (LoRA vs adapters) for ECG segment classification using...	14	Experimental	1	Jupyter Notebook
170	Josh396s/BERT-Contrastive-LoRA Optimizing BERT for intent classification on the Amazon Massive dataset...	14	Experimental	1	Python
171	rawatshaurya/LORA-vs-QLORA Reasoning-style fine-tuning of an instruction LLM using LoRA vs QLoRA,...	14	Experimental	1	Python
172	nehamaheshh/Reasoning-style-fine-tuning-PEFT LoRA vs QLoRA fine-tuning on CommonsenseQA measuring accuracy, GPU memory,...	13	Experimental	—	Python
173	Accrame/finllm-sentiment Fine-tuning LLMs for financial sentiment analysis with QLoRA	13	Experimental	—	Python
174	shubham5027/LLM-Finetuning This repository hands-on fine-tuning experiments on Large Language Models...	13	Experimental	2	Jupyter Notebook
175	BharathiDonku7/Fine_tune_with_Mistral_with_QLORA_PEFT Fine-tuning Mistral-7B and LLaMA using QLoRA & PEFT for efficient LLM...	13	Experimental	—	Jupyter Notebook
176	krutarth3238/slm-lora-finetuning LoRA-based fine-tuning of GPT-2 using multi-domain datasets with PEFT and...	13	Experimental	—	Jupyter Notebook
177	aneessaheba/peft-banking-classifier Fine-tunes Google FLAN-T5-base with LoRA (PEFT) on Banking77 to classify 77...	13	Experimental	—	Jupyter Notebook
178	kaiser-data/llm-finetune-kit 🚀 Beginner-friendly Python library for fine-tuning LLMs. 3-line training,...	13	Experimental	—	Python
179	Himanshu0508Raturi/Fine_Tuning-LLM This repository shows how to fine tune Llama3.2-Instruct model on custom...	13	Experimental	—	Jupyter Notebook
180	nikolareljin/finetorch Rust-native LLM finetuning toolkit for LoRA/QLoRA, dataset preparation,...	13	Experimental	—	Rust
181	swati-mishra07/mcq-rag-app LoRA fine-tuned FLAN-T5 model for automatic MCQ generation with evaluation...	13	Experimental	—	Python
182	Desire32/lora-ml-transfomers LoRA / RAG fine-tuning	13	Experimental	—	Jupyter Notebook
183	azadero/Emotion-Classification-DistilBERT-LoRA A deep learning project focused on fine-tuning DistilBERT for emotion...	13	Experimental	—	Jupyter Notebook
184	meleknurb/llm-finetuning-with-qlora Codecademy project focused on fine-tuning an LLM using QLoRA with the...	13	Experimental	—	Jupyter Notebook
185	hsb943/lora-tinyllama-finetuning End-to-end LoRA fine-tuning of TinyLlama (1.1B) using 4-bit quantization on...	13	Experimental	—	Jupyter Notebook
186	anishdulal/llm-cuad-eval Evaluation of Llama 3.2 3B on CUAD Dataset - before and after finetuning	13	Experimental	—	Jupyter Notebook
187	PrateekKacham/mistral-7b-text2sql-finetuning Fine-tuning Mistral 7B for Text-to-SQL generation using QLoRA — 200%...	13	Experimental	—	Jupyter Notebook
188	Travor278/SEED-LLaVA Single-GPU reproduction of SEED for hallucination mitigation in...	13	Experimental	—	Python
189	alfredang/finetuning-llm-huggingface 🤖 Fine-tune Qwen3-0.6B for IT support ticket routing using LoRA + Unsloth....	13	Experimental	—	Python
190	johnayoung/eth-finetuning-cookbook Educational cookbook for fine-tuning LLMs on Ethereum transaction data using QLoRA	13	Experimental	—	Python
191	punyamodi/lora-finetune-studio Full-stack LoRA fine-tuning studio for large language models with Gradio UI,...	13	Experimental	—	Python
192	Dhyani2206/Domain_Specialized_LLaMA Fine-tuning LLaMA-3, Mistral-7B, and Phi-3 using QLoRA on a curated Data...	13	Experimental	—	Jupyter Notebook
193	SCCSMARTCODE/Deep-Learning-03-LLM-FineTuning Scalable and modular framework for fine-tuning large language models (LLMs)...	13	Experimental	—	Jupyter Notebook
194	mxagar/llm_peft_fine_tuning_example Example project in which a Large Language Model is fine-tuned using PEFT.	13	Experimental	—	Jupyter Notebook
195	IlyyinKashaf/MarketingMuse Fine-tuned TinyLlama-1.1B (Decoder-Only) via 3-phase training (domain...	13	Experimental	—	Jupyter Notebook
196	sdtrkl/lightweight-fine-tuning This project is part of Generative AI Nanodegree by Udacity	13	Experimental	—	Jupyter Notebook
197	Mo-Shakib/llama3.2-3b-lora-finetuning-kit Fast, memory-efficient LoRA fine-tuning toolkit for...	13	Experimental	—	HTML
198	SamsungSAILMontreal/mulo μLO: Compute-Efficient Meta-Generalization of Learned Optimizers [to appear...	13	Experimental	—	—
199	rizalsimb1/context-manager Fine-tune large language models (Llama 3, Mistral, Phi-3) with LoRA and...	13	Experimental	—	—
200	anilsrml/LLM-FineTuning-QLora Kumru-2B büyük dil modelinin, tıbbi veriler (TUS sınavı) üzerinde QLoRA...	13	Experimental	—	—
201	Rishi625/LLM-Finetune-Pipeline Production-grade ML pipeline for Llama 3.2 fine-tuning with LoRA/QLoRA,...	13	Experimental	—	Python
202	ZeeetOne/bioinstruct-finetuning-experiment LoRA fine-tuning experiment: Llama-3.2-1B-Instruct + BioInstruct dataset...	13	Experimental	—	Jupyter Notebook
203	soniatyburczy/llama2-qlora-sft-coverletter-project Implementation of a task-specific QLoRA supervised fine-tuning pipeline for...	12	Experimental	1	Python
204	aasherkamal216/15_Days_Fine_Tuning_Challenge A collection of notebooks for fine-tuning LLMs using Unsloth AI	12	Experimental	3	Jupyter Notebook
205	azizdeniz890/gemma-medical-qa-lora This project presents a medical question–answering language model built by...	12	Experimental	1	Jupyter Notebook
206	notdanna/GPoemsT A modular Transformer-based architecture for constrained poetic generation,...	12	Experimental	1	Jupyter Notebook
207	nabeelshan78/math-vlm-finetune-pipeline A production-ready, modular fine-tuning pipeline for converting handwritten...	12	Experimental	1	Jupyter Notebook
208	programindz/lora-vit-finetuning Fine-Tuning Google's Vision Transformer LoRA technique. Two different LoRA...	12	Experimental	8	Jupyter Notebook
209	Sid3503/LoRA A beginner-friendly guide to Low-Rank Adaptation (LoRA) - the efficient...	11	Experimental	2	Jupyter Notebook
210	mominalix/LLM-Finetuning-Pipeline-LoRA-QLoRA Production-ready pipeline for fine-tuning Large Language Models using...	11	Experimental	2	Python
211	benhaotang/LoRa-Finetune-Navi finetune models with AMD navi cards like 7700/7800/7900XT	11	Experimental	—	Jupyter Notebook
212	hugoaslm/Mesh-Generation-Medical-Shapes Efficient LLaMA-Mesh fine-tuning to produce printable medical meshes	11	Experimental	1	Jupyter Notebook
213	andresnowak/mnlp_mcqa_model Finetuning of Qwen3 0.6B for MCQA tasks	11	Experimental	2	Python
214	RATHOD-SHUBHAM/Finetuning-LLMs This repository contains experiments on fine-tuning LLMs (Llama, Llama3.1,...	11	Experimental	1	Jupyter Notebook
215	AlbertChoo/NLP-Projects Hmm, projects with, transformers, pre-trained model, finetuning LLM using...	11	Experimental	1	Jupyter Notebook
216	tien02/llm-math Fine tune Large Language Model on Mathematic dataset	11	Experimental	4	Python
217	Reason-Wang/InstructLLM The official implementation of paper "Demystifying Instruction Mixing for...	11	Experimental	4	Python
218	Morsinaldo/GAIND-Light-Weight-Fine-Tuning This repository contains the Light Weight Fine Tuning project implementation...	11	Experimental	—	Jupyter Notebook
219	arjuntheprogrammer/RLHF-LoRA-PyTorch-Llama-3.1-8B Full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware.	11	Experimental	—	Python
220	thekaranacharya/llm-fine-tuning Comparing popular Parameter Efficient Fine-Tuning (PEFT) techniques for...	11	Experimental	—	Python
221	flozi00/simplepeft An simple trainer for efficient finetuning large models on different tasks	11	Experimental	—	Python
222	veydantkatyal/Llama-LoRA-FineTuning Practical guide to fine-tuning the LLaMA model for dialogue summarisation...	11	Experimental	—	Jupyter Notebook
223	dannylee1020/panim Generate manim code with LLM	10	Experimental	1	Python
224	antonio-f/llama2_colab Fine-Tune Your Own Llama 2 Model LOCALLY in a Colab Notebook	10	Experimental	2	Jupyter Notebook
225	chanupadeshan/LoRA-Fine-Tune Fine-tuning TinyLlama-1.1B-Chat using LoRA on the GSM8K dataset for solving...	10	Experimental	1	Python
226	KindYAK/kaggle_20q Solution for Kaggle 20 Questions competetion	10	Experimental	2	Jupyter Notebook
227	Alessio2405/fine_tuning_llama_2_Xb Python script to fine tune LLaMA-Xb with your custom data.	10	Experimental	2	Python
228	dhdbsrlw/Instruct-Tune-LLaMA-with-PEFT-Techniques COSE474 DL Project (Prof. Hyun-Woo Kim)	10	Experimental	2	Jupyter Notebook
229	Gholamrezadar/finetune-llama-3.2-qlora-text2sql Finetuning Llama-3.2-3B on Text2SQL using QLoRA	10	Experimental	2	Jupyter Notebook
230	nebrelbug/llm_trainer Comprehensible scripts to instruction-tune a LLaMA model	10	Experimental	2	Python

Comparisons in this category

unsloth and LlamaFactory (81 vs 67) ms-swift and LlamaFactory (78 vs 67) oumi and LlamaFactory (77 vs 67) LlamaFactory and LLM-Finetuning (67 vs 45) LlamaFactory and LLamaTuner (67 vs 44) unsloth and oumi (81 vs 77) unsloth and LLamaTuner (81 vs 44) peft and LLM-Finetuning (80 vs 45) ms-swift and LLM-Finetuning (78 vs 45) oumi and simple-llm-finetuner (77 vs 44)