Model Fine-Tuning Methods NLP Tools

Tools, frameworks, and implementations for fine-tuning pre-trained language models using techniques like LoRA, QLoRA, and full fine-tuning. Includes parameter-efficient adaptation methods, fine-tuning strategies, and comparative analyses. Does NOT include applications of fine-tuning to specific downstream tasks (those belong in task-specific categories) or general model training from scratch.

There are 31 model fine-tuning methods tools tracked. The highest-rated is uds-lsv/bert-stable-fine-tuning at 43/100 with 138 stars.

Get all 31 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=nlp&subcategory=model-fine-tuning-methods&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	uds-lsv/bert-stable-fine-tuning On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and...	43	Emerging	138	Python
2	MeryylleA/lunariscodex A high-performance PyTorch toolkit for pre-training modern, Llama-style...	42	Emerging	13	Python
3	VanekPetr/flan-t5-text-classifier Fine-tuning of Flan-5T LLM for text classification 🤖 focuses on adapting a...	38	Emerging	44	Python
4	kingTLE/literary-alpaca2 从词表到微调这就是你所需的一切	31	Emerging	239	Python
5	YuweiYin/HLT-MT [IJCAI-ECAI 2022] HLT-MT: High-resource Language-specific Training for...	31	Emerging	4	Python
6	oatanas/containerized-transformer-finetuning Containerized Transformer Fine-Tuning	29	Experimental	10	Jupyter Notebook
7	RunxinXu/ChildTuning Source code for our EMNLP'21 paper 《Raise a Child in Large Language Model:...	29	Experimental	62	Python
8	aymen-000/predict-reconstruct-language-models "Predict and Reconstruct: Joint Objectives for Self-Supervised Language...	28	Experimental	2	Python
9	SlaabAI/TuneForge TuneForge is a dataset generation tool for training and fine-tuning LLMs. It...	25	Experimental	3	TypeScript
10	andrea-cavallo-98/Low-resource-Machine-Translation Multilingual finetuning of Machine Translation model on low-resource...	25	Experimental	8	Jupyter Notebook
11	Surya-Hariharan/Paraphrase-Detection-using-Siamese-Network Document-level paraphrase detection using Siamese Neural Network with SBERT...	24	Experimental	1	Python
12	blackccpie/GweLLM Journey towards Fine-Tuning a Breton speaking Chat Model	21	Experimental	4	Python
13	chtmp223/suri Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)	21	Experimental	27	Python
14	ratteripenta/transformers-seminar-workshop Notebooks for teaching transformers and fine-tuning a pre-trained BERT model	21	Experimental	7	Jupyter Notebook
15	SJ-Ray/Manual_Fine_Tune_Vectors Manual Fine Tune Sentence Transformer Embeddings	20	Experimental	8	Jupyter Notebook
16	dzungphieuluuky/Finetune-DeepSeekOCR Finetuning DeepSeek-OCR on a small dataset with unsloth notebook. Assignment...	20	Experimental	1	Jupyter Notebook
17	Bharathyalagi/Fine-Tuning-a-LLaMA-2-Model-on-Medical-Text-Data-Using-Hugging-Face This project demonstrates how to fine-tune a pretrained LLaMA 2 model using...	20	Experimental	1	Jupyter Notebook
18	kenilc/finetune4textgen A python script to fine-tune pre-trained models for text generation	20	Experimental	5	Python
19	KoreaMGLEE/Concept-based-curriculum-masking Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking	19	Experimental	13	Python
20	oelin/mlp-language-model A 2M parameter neural language model trained on the TinyStories corpus.	19	Experimental	4	Python
21	elenanereiss/Limits-of-LLMs-for-German-Text-Classification This repo is dedicated to an analysis of the LLMs performance as text...	19	Experimental	3	Python
22	niloydebbarma-code/LORA-FINETUNING-BANGLASENTI-XLMR-GOOGLE-TPU First open-source LoRA fine-tuning of BanglaSenti on XLM-RoBERTa-base for...	18	Experimental	1	Python
23	mariovas3/bert-lora Finetuning BERT with LoRA	17	Experimental	1	Python
24	njallskarp/finetune-qa-powerset Finetuning BERT models on a powerset of different linguistic domains	12	Experimental	5	Python
25	CllsPy/fine-tuning-llms Fine-Tuning Bert and Friends	11	Experimental	—	Jupyter Notebook
26	Lake-Wang/NLP_Adapter_Parameter_Allocation This project investigates the robustness of parameter allocation strategies...	11	Experimental	1	Python
27	nabeelshan78/NLP-From-Scratch-to-Deployment An end-to-end project where I built a Transformer from scratch, fine-tuned...	10	Experimental	1	Jupyter Notebook
28	pritamgouda11/Text-Generation-LoRA-and-Knowledge-Distillation This repository contains the solutions and discussions for Assignment #2 of...	10	Experimental	2	Python
29	remcofl/NLP-Explanations-for-NLI Fine-tuning and evaluation of a language model for explanation generation of...	10	Experimental	2	Jupyter Notebook
30	lucalila/fishpal Master Thesis on "Comparing Modular Approaches for Parameter-Efficient Fine-Tuning"	10	Experimental	2	Python
31	mhmdsabry/ResLM Querying a Language model in a residual path for drug-target interaction task	10	Experimental	2	Python