Llm Finetuning Frameworks Transformer Models

There are 62 llm finetuning frameworks models tracked. 2 score above 50 (established tier). The highest-rated is Goekdeniz-Guelmez/mlx-lm-lora at 62/100 with 284 stars.

Get all 62 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=llm-finetuning-frameworks&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	Goekdeniz-Guelmez/mlx-lm-lora Train Large Language Models on MLX.	62	Established	284	Python
2	uber-research/PPLM Plug and Play Language Model implementation. Allows to steer topic and...	50	Established	1,155	Python
3	VHellendoorn/Code-LMs Guide to using pre-trained large language models of source code	48	Emerging	1,842	Python
4	ssbuild/chatglm_finetuning chatglm 6b finetuning and alpaca finetuning	47	Emerging	1,537	Python
5	jarobyte91/pytorch_beam_search A lightweight implementation of Beam Search for sequence models in PyTorch.	45	Emerging	59	Python
6	SmallDoges/small-doge Doge Family of Small Language Models	44	Emerging	185	Python
7	XXO47OXX/layer-scan Automated LLM layer duplication config scanner — find the optimal (i,j) for...	44	Emerging	3	Python
8	anseryuer/Local_LLM_Deployment_Guide_Chinese 本地部署大语言模型的中文教学	44	Emerging	43	—
9	Kakz/prometheus-llm PrometheusLLM is a unique transformer architecture inspired by dignity and...	41	Emerging	5	Python
10	piresramon/gpt-4-enem Code and data to evaluate LLMs on the ENEM, the main standardized Brazilian...	41	Emerging	52	Python
11	OpenLemur/Lemur [ICLR 2024] Lemur: Open Foundation Models for Language Agents	40	Emerging	557	Python
12	virevolai/logos-shift-client Replace expensive LLM calls with finetunes automatically	39	Emerging	66	Python
13	WENGSYX/LMTuner LMTuner: Make the LLM Better for Everyone	38	Emerging	38	Python
14	jlin816/dynalang Code for "Learning to Model the World with Language." ICML 2024 Oral.	38	Emerging	414	Python
15	casinca/LLM-quest Verbose implementations of LLMs architectures, techniques and research...	37	Emerging	12	Python
16	Love-Asuka/Etude-LLM "Etude"一词源自法语，原意为"研习曲"或"练习曲"，在音乐领域特指为提高演奏技巧而创作的短小精悍的乐曲。在本项目中，"Etude...	37	Emerging	5	Python
17	Ethyros-AI/ModelCypher ModelCypher - Decipher the high dimensional geometry of LLMs. An open source...	37	Emerging	19	Python
18	olaflaitinen/llm-proteomics-hallucination Systematic evaluation of hallucination risks in Large Language Models...	37	Emerging	9	Python
19	clint-kristopher-morris/llm-guided-evolution LLM Guided Evolution - The Automation of Models Advancing Models	36	Emerging	16	Python
20	Samyak-777/nomodel The world's most accurate LLM. It achieves 0% hallucination rate by...	36	Emerging	3	Dockerfile
21	mcp-tool-shop-org/backpropagate Headless LLM fine-tuning in 3 lines — smart defaults, VRAM-aware batch...	34	Emerging	1	Python
22	mikecvet/beam LLM Beam Search Example Implementation	32	Emerging	13	Python
23	anas-zafar/LLM-Survey The official GitHub page for the survey paper "A Survey on Large Language...	32	Emerging	40	—
24	Aradhye2002/selective-peft-toolkit Official implementation of the paper "Step-by-Step Unmasking for...	31	Emerging	9	Python
25	ai4sd/multiscale-byte-lm A hierarchical LM that scales to training on context windows of +5M tokens	31	Emerging	9	Python
26	kyegomez/SelfExtend Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend...	30	Emerging	13	Python
27	izmttk/ullm Lightweight LLM inference engine inspired by nano-vllm, with radix-tree...	30	Emerging	9	Python
28	eilamc14/Simplify-This Comparative Analysis of Prompt-Based and Fine-Tuned LLMs	28	Experimental	3	Jupyter Notebook
29	LaMP-Benchmark/LaMP Codes for papers on Large Language Models Personalization (LaMP)	28	Experimental	188	Python
30	jesusvilela/IGBundle-LLM IGBundle LLM is an experimental framework for adapting Large Language Models...	27	Experimental	1	Python
31	eigencore/Tlama_124M Tlama (124M) is a language model based on LlaMa3 (127M) optimized by...	27	Experimental	12	Python
32	uw-swag/tokdrift Repository for TokDrift: When LLM Speaks in Subwords but Code Speaks in Grammar.	26	Experimental	9	Python
33	yadavsidhant/quickllm QuickLLM: Fast and Easy Fine-tuning for Popular Language Models	26	Experimental	1	Python
34	Hashmat02/Fine-Tuning-LLaMA-2-for-Toxicity-Classification Fine-tuning LLaMA 2 for toxicity classification using a balanced Kaggle...	25	Experimental	6	Jupyter Notebook
35	Khaeldur/NeuralForge On-device LLM fine-tuning for Apple Silicon (ANE)	25	Experimental	5	Swift
36	waybarrios/dgx-spark-finetune-llm LLM fine-tuning with LoRA + NVFP4/MXFP8 on NVIDIA DGX Spark (Blackwell GB10)	24	Experimental	11	Python
37	Talnz007/VulkanIlm GPU-accelerated LLaMA inference wrapper for legacy Vulkan-capable systems a...	24	Experimental	28	Python
38	raajmandale/mos-parameter-golf CRS-LM: Structure-aware context reduction for tiny language models under...	23	Experimental	1	Python
39	shiv81500/Mobius-LLM-Fine-tuning-Engine 🔧 Fine-tune large language models locally on your data, export to GGUF, and...	22	Experimental	—	Python
40	KouseiA/AGI_HER_LLM 🚀 Adapt large language models continuously with task-agnostic methods,...	21	Experimental	1	Python
41	Ari-S-123/pii-masking Improved PII masking performance in adversarial conditions and diverse...	20	Experimental	1	Jupyter Notebook
42	Optum/long-medical-document-lms Explain and train language models that extract information from long medical...	20	Experimental	7	Jupyter Notebook
43	Saivineeth147/LLM-Compass The ultimate collection of resources for building, evaluating, and...	20	Experimental	4	—
44	ryan-air/Alpaca-3B-Fine-Tuned In this project, I have provided code and a Colaboratory notebook that...	20	Experimental	6	Jupyter Notebook
45	kapshaul/LLM-finetune-vuln-detection Fine-tuning a Large Language Model (LLM) for code vulnerability detection...	20	Experimental	10	Python
46	Mxbonn/ltmp Code for Learned Thresholds Token Merging and Pruning for Vision...	19	Experimental	17	Python
47	barbidoux/Lumi-Lab A simple mini LLM training project to train your LLM from scratch, from the...	17	Experimental	—	Python
48	MarsPain/easy_llm.cpp A minimal C++ framework for learning and understanding the LLM inference...	17	Experimental	5	C++
49	jordandeklerk/OpenCodeInterpreter-Finetune-SQL Fine-tuning coding LLM OpenCodeInterpreter-DS-6.7B for Text-to-SQL Code...	17	Experimental	1	Jupyter Notebook
50	introlix/Swiftlet SwiftLet is a lightweight Python framework for running open-source Large...	16	Experimental	28	Python
51	Scottcjn/pse-vcipher-collapse Non-bijunctive attention collapse for LLM inference — POWER8 hardware AES...	16	Experimental	3	C
52	sacredvoid/alignrl LLM post-training playbook: SFT, GRPO, DPO, eval, and inference. pip install alignrl	14	Experimental	—	Python
53	MukundaKatta/grammarprobe GrammarProbe — Universal Grammar Detector. Test whether LLMs have...	14	Experimental	—	Python
54	PrincySinghal/Html-code-generation-from-LLM Fine-Tuning and Evaluating a Falcon 7B Model for generating HTML code from...	13	Experimental	11	Jupyter Notebook
55	rodgersmag/tinyllm TinyLLM is a research project focused on developing and training compact,...	13	Experimental	6	Python
56	mateluky/llm-heart-failure-analysis Research project evaluating large language models (LLMs) for heart failure...	13	Experimental	—	—
57	sanwooo/mts-llm-aes [EMNLP24 Findings] Unleashing Large Language Models’ Proficiency in...	12	Experimental	7	Python
58	pspdada/LLM-Learning-Notes 学习大语言模型（LLM）的历程和笔记	12	Experimental	5	Python
59	TruongNV-hut/AIcandy_LLM_Finetuning_bloom_560m_iehimqko Fine-tuning large language models	12	Experimental	7	Python
60	lgupta-mle/llm_from_scratch Here, I implement every single component in typical LLM architectures from...	12	Experimental	7	Python
61	hernandezb3/llama-on-uconn-hpc running llama models on UConn Storrs HPC	11	Experimental	1	Python
62	AmanPriyanshu/Stratified-LLM-Subsets-100K-1M-Scale Stratified LLM Subsets delivers diverse training data at 100K-1M scales...	10	Experimental	1	HTML