LLM Frameworks & Libraries LLM Tools

Frameworks, libraries, and toolkits for building, training, and integrating LLMs across various languages and environments. Does NOT include deployed applications, end-user tools, or domain-specific implementations (those belong in specialized categories like rag-applications or langchain-chatbot-applications).

There are 144 llm frameworks & libraries tools tracked. 11 score above 50 (established tier). The highest-rated is AI-Planning/l2p at 60/100 with 48 stars. 2 of the top 10 are actively maintained.

Get all 144 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=llm-frameworks-libraries&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	AI-Planning/l2p Library for LLM-driven action model acquisition via natural language	60	Established	48	Python
2	datawhalechina/self-llm 《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程	59	Established	28,927	Jupyter Notebook
3	microsoft/LMOps General technology for enabling AI capabilities w/ LLMs and MLLMs	58	Established	4,292	Python
4	theaniketgiri/create-llm The fastest way to build and start training your own LLM. CLI tool that...	57	Established	322	TypeScript
5	liguodongiot/llm-action 本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）	57	Established	23,504	HTML
6	ar-jan/llm-venice LLM plugin for Venice AI	56	Established	24	Python
7	StanfordSpezi/SpeziLLM Large Language Model (LLM) module for the Spezi Ecosystem	55	Established	279	Swift
8	NatLabRockies/elm ELM is a collection of utilities to apply Large Language Models (LLMs) to...	54	Established	69	Python
9	hyperai/vllm-cn vLLM Documentation in Chinese Simplified / vLLM 中文文档	51	Established	160	TypeScript
10	InternLM/InternLM Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).	51	Established	7,165	Python
11	Nerif-AI/Nerif LLM-powered Python	50	Established	15	Python
12	Vastai/VastModelZOO VastModelZOO...	49	Emerging	27	Python
13	MiniMax-AI/MiniMax-M2.1 MiniMax M2.1, a SOTA model for real-world dev & agents.	48	Emerging	532	—
14	MiniMax-AI/MiniMax-M2 MiniMax-M2, a model built for Max coding & agentic workflows.	48	Emerging	2,474	—
15	MiuLab/Taiwan-LLM Traditional Mandarin LLMs for Taiwan	46	Emerging	1,396	Python
16	baichuan-inc/Baichuan2 A series of large language models developed by Baichuan Intelligent Technology	45	Emerging	4,117	Python
17	baichuan-inc/Baichuan-13B A 13B large language model developed by Baichuan Intelligent Technology	45	Emerging	2,944	Python
18	CLUEbenchmark/SuperCLUE SuperCLUE: 中文通用大模型综合性基准 \| A Benchmark for Foundation Models in Chinese	44	Emerging	3,277	—
19	ashvardanian/TinySemVer Tiny Semantic Versioning (SemVer) library with LLMs and GitHub CI, that...	44	Emerging	27	Python
20	Zjh-819/LLMDataHub A quick guide (especially) for trending instruction finetuning datasets	44	Emerging	3,369	—
21	cxcscmu/Craw4LLM Official repository for "Craw4LLM: Efficient Web Crawling for LLM Pretraining"	43	Emerging	650	Python
22	SteveKGYang/MentalLLaMA This repository introduces MentaLLaMA, the first open-source instruction...	43	Emerging	306	Python
23	mtkresearch/MR-Models 聯發創新基地（MediaTek Research)...	43	Emerging	266	—
24	erdogant/LLMlight LLMlight is a lightweight Python library for running local language models...	43	Emerging	1	Jupyter Notebook
25	HCPLab-SYSU/Book-of-MLM 《多模态大模型：新一代人工智能技术范式》作者：刘阳，林倞	43	Emerging	264	HTML
26	OpenSQZ/MegatronApp Toolchain built around the Megatron-LM for Distributed Training	42	Emerging	90	Python
27	manthanguptaa/real-world-llm-apps curated collection of real world applications that use LLMs	42	Emerging	295	Python
28	inclusionAI/Ling Ling is a MoE LLM provided and open-sourced by InclusionAI.	41	Emerging	240	Python
29	attentionmech/mav Model Activity Visualiser	41	Emerging	522	Python
30	LiorGazit/llmpop The library that lets you spin up any LLM in a unified command.	40	Emerging	1	Jupyter Notebook
31	Azure99/BlossomLM A powerful, open-source large language model, including the training data.	40	Emerging	176	Python
32	hunch-app/declarai A Pythonic integration for LLMs.	40	Emerging	88	Python
33	salesforce/xgen Salesforce open-source LLMs with 8k sequence length.	40	Emerging	726	Python
34	HIT-SCIR/Chinese-Mixtral-8x7B 中文Mixtral-8x7B（Chinese-Mixtral-8x7B）	40	Emerging	654	Python
35	FareedKhan-dev/basiclingua-LLM-Based-NLP LLM Based NLP Library.	40	Emerging	89	Python
36	FreedomIntelligence/BlenderLLM BlenderLLM: A LLM specifically designed to generate CAD scripts based on...	40	Emerging	212	Python
37	kleer001/Text_Loom Network for procedural editing of text with LLMs	39	Emerging	23	Python
38	HIT-SCIR/huozi 活字通用大模型	39	Emerging	394	Python
39	Yu-Yang-Li/StarWhisper LLM for Astronomy[星语4.0]	39	Emerging	313	Python
40	inclusionAI/Ling-V2 Ling-V2 is a MoE LLM provided and open-sourced by InclusionAI.	39	Emerging	264	Python
41	phodal/aigc 《构筑大语言模型应用：应用开发与架构设计》一本关于 LLM...	39	Emerging	1,631	Rust
42	alphrc/lilm Large language model fine-tuned to mimic LIHKG users' behavior	39	Emerging	119	Python
43	l294265421/my-llm All about large language models	39	Emerging	52	—
44	gpavanb1/LLaMArch Minimal, Building Blocks for Large Language Models!	39	Emerging	1	Python
45	mallahyari/llm-hub A curated collection of interesting applications, repos, and tutorials using...	39	Emerging	153	—
46	uiuing/varbook 适合中文程序员的变量命名助手，LLM+知识库，规范变量命名，定制化变量命名规则	38	Emerging	215	HTML
47	julep-ai/steadytext Deterministic text generation and embeddings with zero configuration	38	Emerging	42	PLpgSQL
48	ACADLab/SPICEPilot This repository hosts the information of SPICEPilot: a training free LLM...	38	Emerging	31	Python
49	mattmerrick/llmlogs A blog dedicated to helping creators, developers, and curious minds...	37	Emerging	12	HTML
50	PennShenLab/MentalChat16K A benchmark dataset designed to support the development and evaluation of...	37	Emerging	17	—
51	zhangzhengde0225/Xiwu Xiwu: A Large Lanauge Model for High Energy Physics	37	Emerging	21	Python
52	Remmie0/OpenFunsearch Open Funsearch implementation of Google Deepmind's Funsearch	36	Emerging	9	Jupyter Notebook
53	wenge-research/YAYI2 YAYI 2 是中科闻歌研发的新一代开源大语言模型，采用了超过 2 万亿 Tokens 的高质量、多语言语料进行预训练。(Repo for YaYi 2...	35	Emerging	3,308	Python
54	intentee/llmops-handbook Practical and advanced guide to LLMOps. It provides a solid understanding of...	35	Emerging	79	CSS
55	pea3nut/awesome-llm-zh 大语言模型中文资源归总！	35	Emerging	8	—
56	githubnext/UpgrAIder Upgrade deprecated/outdated code using LLMs and release notes	34	Emerging	8	Python
57	sec3-service/Owl-LM Large Language Model for Blockchain	34	Emerging	60	Jupyter Notebook
58	top-on/llmask A command-line tool for masking authorship of text, by changing the writing...	34	Emerging	10	Python
59	patrick-tssn/LM-Research-Hub Language Modeling Research Hub, a comprehensive compendium for enthusiasts...	34	Emerging	19	Python
60	sshh12/llm_oracle LLM Oracle is a GPT-4 powered tool for predicting future events. It's like a...	34	Emerging	19	Python
61	Jerryym/AICAD LLM在CAD中的应用程序开发	34	Emerging	4	C++
62	ahpxex/open-dictionary The genuine open dictionary, grounded by Wikitionary and explained more with LLMs	34	Emerging	114	Python
63	IvanaXu/CQMC LLM + 中文文本匹配 Chinese Question Matching Corpus	33	Emerging	5	Python
64	pstutz/syncodia Bridging Large Language Models with Scala 3 Functions	33	Emerging	11	Scala
65	LLMine/llmine_core Your Platform for Text Mining through Configurable LLM Chains. Ideal for...	31	Emerging	38	Python
66	FlagAI-Open/Aquila2 The official repo of Aquila2 series proposed by BAAI, including pretrained &...	31	Emerging	444	Python
67	svilupp/LLMTextAnalysis.jl Effortlessly uncover and label thematic insights in large document...	31	Emerging	41	Julia
68	llmapi-io/llm-linker :link: LLM links to everything !	31	Emerging	2	Python
69	DrResh/LLM-Cheat-Sheets LLM Based Learning Cheat sheets for quick reference	31	Emerging	13	—
70	edaaydinea/llm_mastery Learn to master the latest in Large Language Models (LLMs) including...	31	Emerging	1	Jupyter Notebook
71	KCaverly/cog-models A collection of cog models for use on Replicate	30	Emerging	23	Python
72	mac999/blender-llm-addin Text-to-3D Model addin for Blender using Ollama and OpenAI GPT	30	Emerging	21	Python
73	TyrelM10/LLM-to-PDDL Building domain knowledge specifically in PDDL from natural language...	29	Experimental	1	Python
74	BobMcDear/llaf LLMs in Futhark	28	Experimental	12	Futhark
75	hululuzhu/llm-primer A primer on large language models (LLM) as of Jan 2023, with bonus ChatGPT topic	27	Experimental	20	—
76	longyuewangdcu/GuoFeng-Webnovel Multilingual Corpus of Web Fiction	27	Experimental	201	Ruby
77	nercone-dev/zeta-llm Fully Open-source LLM	26	Experimental	6	—
78	bobazooba/wgpt This repository features an example of how to utilize the xllm library....	25	Experimental	8	Python
79	shure-dev/logllm Automatically extract ML experimental conditions from your Python scripts...	25	Experimental	3	Python
80	arcee-ai/arcee-python The Arcee client for executing domain-adpated language model routines...	24	Experimental	28	Python
81	yezhengkai/LawGPT An experimental project to fine-tune a LLM using ROC law-related content	24	Experimental	4	Python
82	CYBIRD-D/How-to-Choose-your-LLM-Model-for-translation This is a post for beginners to choose the LLM Models suit themselves to...	24	Experimental	5	—
83	FunnySaltyFish/bilibili_comments_crawl 基于 B 站评论区数据构建大语言模型训练用对话数据集	24	Experimental	59	Python
84	aryyyy01/minimind 🧠 Simplify your machine learning workflow with MiniMind, a collection of...	24	Experimental	1	Python
85	dhaval-vedra/lowmind LowMind - Ultra-Lightweight Deep Learning Framework for Low-End Devices	23	Experimental	2	Python
86	ZhaoDevHub/SeedLLM Ultra-lightweight foundational LLM framework for beginners and teaching.	22	Experimental	—	Python
87	mehmandarov/llm-security-and-predictability Demo code and examples for the talk "Taming the Chaos". It demonstrates...	22	Experimental	—	Java
88	tsen1220/minimax-sdk SDKs for MiniMax APIs — Text, Speech, Video, Image, Music & Files	22	Experimental	—	Python
89	Pro1943/NanoMind A Small Language Model built from scratch in pure Python and PyTorch. Train...	22	Experimental	1	Python
90	InternLM/InternLM-Law [COLING 2025] InternLM-Law: An Open Source Chinese Legal Large Language Model	22	Experimental	16	—
91	chukjosh/BibleLLM A lightweight, PyTorch-based character-level Transformer Language Model...	22	Experimental	—	Python
92	mrbadr1243/variational-learning-playground Explore, test, and benchmark variational learning methods with an extensible...	22	Experimental	—	Python
93	vahagn-madatyan/dgx-spark-lab DGX Spark hands-on ML training lab — model training, fine-tuning, and...	22	Experimental	—	HTML
94	soenneker/soenneker.attributes.llms.properties An attribute for describing properties to LLMs	22	Experimental	—	C#
95	neomakes/eigen-llm Decomposing large general AI into small, specialized intelligence.	22	Experimental	—	—
96	ristponex/awesome-minimax 🧠 Awesome MiniMax M2 Series — Track M2, M2.1, M2.5, M2.7 and the evolution...	22	Experimental	—	—
97	mapio/selma Search Engines and Language Models Animations	22	Experimental	—	Jupyter Notebook
98	dpavlis/llm_feedback A multi-user web application for testing and evaluating (own) LLM models...	22	Experimental	—	Python
99	zetavg/twlm Taiwanese Mandarin LLM Project	22	Experimental	19	Python
100	justinamiller/SmallMind SmallMind is a production-ready, local language model inference engine built...	21	Experimental	—	C#
101	luciITby/OpenLabLM 🚀 Build your own LLM easily with OpenLabLM, a lightweight, hackable codebase...	21	Experimental	—	Python
102	KKenny0/LLMpedia 搜集和分享个人喜欢的大语言模型（LLM）相关资源的在线百科全书。涵盖 LLM 的基础知识、研究进展、技术应用、工具和最佳实践。	21	Experimental	1	HTML
103	yrvelez/auto_vignette Toy example of how LLMs can be used to create survey experiments	21	Experimental	1	PHP
104	abhishekraok/wandering-light A Python library for LLM tool call mastery through self play.	21	Experimental	—	Python
105	ahmadghazinazer/forge-ml End-to-end platform for LLM post-training. Dataset versioning, training...	21	Experimental	—	JavaScript
106	branded12345/Geo-Llama 🌐 Enhance language understanding through geometric deep learning with...	21	Experimental	—	Python
107	TinyTalks/Butterfly Butterfly: An Open NLP Research Project for Chinese Danmaku，B站弹幕NLP社区建设	20	Experimental	7	—
108	llmupdate/pages LLMUpdate, 大模型周报 -- 每周大模型和AI的重要进展，跟进值得关注的技术进步、产品创新 https://llmupdate.com	20	Experimental	7	HTML
109	benthecoder/llms llm playground	20	Experimental	10	Python
110	ejhusom/MELODI Use local Large Language Models (LLMs) while monitoring energy usage.	20	Experimental	16	Jupyter Notebook
111	VanVan120/Malay-to-Code-LLM A research project to fine-tune a Large Language Model (LLM) to generate...	20	Experimental	4	Jupyter Notebook
112	BorjaOteroFerreira/IALab-Suite Tool for test diferents large language models without code.	20	Experimental	18	Python
113	iakashpaul/Eastworld Keeping Westworld alive via LLMs 🦾	19	Experimental	3	—
114	keli-wen/AGI-Study The blog, read report and code example for AGI/LLM related knowledge.	19	Experimental	58	Python
115	viktorbezdek/definitive-llm-writing-style-guide The Definitive Guide to LLM Writing Styles	19	Experimental	17	—
116	ella0333/LLM-Scribe LLM Scribe is a toolkit for creating handwritten datasets quickly and easily...	18	Experimental	1	—
117	VrianCao/InfoLLM A repository that introduces content related to LLM in Chinese.	18	Experimental	2	—
118	aiworkspace/cangjie Cangjie - Yet Another open-source LLM Building and Training Framework	17	Experimental	1	—
119	i-nahornyi/gatling-llm-demo Example of testing an LLM with Gatling	17	Experimental	—	Java
120	yhzhu99/llm-mdt Multiple large language models as a multidisciplinary team	15	Experimental	2	TypeScript
121	dharunkumars-hub/LLM-and-Chatbot A Large Language Model (LLM) is a type of AI trained on massive datasets to...	14	Experimental	—	Jupyter Notebook
122	blakeb211/billcat-local-llm Categorize credit card transactions using a local large language model...	14	Experimental	15	Python
123	AICTJ/PetroCLM 石油领域语言模型 PetroCLM	14	Experimental	17	—
124	radeeyate/toastyroast Get burnt by an LLM...	14	Experimental	6	HTML
125	anthony-maio/Eve-0.5B-saber Eve-3-SABER-0.5B: 0.5B parameter code + tool use model with novel...	13	Experimental	—	Jupyter Notebook
126	matthew-potts/LLMs-MacroNews Batch-processing system to support analysis of LLM assessments of macroeconomic news.	13	Experimental	—	Python
127	kodlan/vLLM-ops-lab vLLM Ops Lab	13	Experimental	—	Python
128	rtuszik/lma Language Model Authentication	13	Experimental	—	Python
129	Praveen76/LLM-Projects-Archive The "LLM Projects Archive" is a centralized GitHub repository, offering a...	13	Experimental	—	Python
130	0xnu/tipus-micro-llm Character-level and token-based language models implemented in pure PyTorch.	13	Experimental	—	Jupyter Notebook
131	zhengbangbo/llm-timeline A brief history of Large Language Models. From the launch of ChatGPT to the...	13	Experimental	—	JavaScript
132	llmprogram/llmprogram-docs This is the documentation for the llmprogram library	13	Experimental	—	—
133	wguDataNinja/WGU-Reddit-Feedback-Analyzer LLMs analyzing Reddit posts from WGU students to spot course-level issues....	13	Experimental	—	Python
134	zlown/MiniMax-M2.5 🤖 Empower AI applications with MiniMax-M2.5, a streamlined, efficient model...	13	Experimental	—	JavaScript
135	turtacn/unimodel UniModel：An open-source lightweight, efficient, and unified serving engine...	13	Experimental	—	Rust
136	supinyu/Easy_LLM_Tool 简单的大模型微调工具包	12	Experimental	7	Python
137	dpiponi/TextTree Using LLMs to explore other ways literature could have been written	12	Experimental	5	—
138	YeonwooSung/micro-llm Simple and small LLM implementations	11	Experimental	1	Python
139	patheard/llms Playing around with LLMs	11	Experimental	—	Python
140	vizn3r/llm-finetuning Tools for creating/scraping data, creating datasets and finetuning LLMs	11	Experimental	—	Go
141	SolerHo/large-model-zoo large model Zoo collect various of large-scale model, include CV and NLP,...	11	Experimental	—	—
142	lightlessdays/DeepVoyager-Artificial-Language-Luminary Artificial Language Luminary (ALL) is an open source Large Language Model...	11	Experimental	—	C
143	angantakpe/mlops 🐙Design · 💻Develop · 🚀Deploy · ⚙️Iterate \| Learning how to responsibly...	11	Experimental	—	Jupyter Notebook
144	XIXUM/nlx this project is about natural language processing with a formal model	11	Experimental	—	Java

Comparisons in this category

Baichuan-13B and Baichuan2 (45 vs 45) MiniMax-M2 and MiniMax-M2.1 (48 vs 48)