LLM Framework Abstractions AI Agents

Core libraries and frameworks that provide unified abstractions, capability mapping, and foundational patterns for building LLM-based agents and applications. Does NOT include domain-specific agents, deployment platforms, or end-user applications—focuses on developer-facing toolkits and architectural standards.

There are 130 llm framework abstractions agents tracked. 1 score above 70 (verified tier). The highest-rated is InfinitiBit/graphbit at 78/100 with 524 stars. 2 of the top 10 are actively maintained.

Get all 130 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=agents&subcategory=llm-framework-abstractions&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Agent	Score	Tier	Stars	Language
1	InfinitiBit/graphbit GraphBit is the world’s first enterprise-grade Agentic AI framework, built...	78	Verified	524	Rust
2	autogluon/autogluon-assistant Multi-Agent System Powered by LLMs for End-to-end Multimodal ML Automation	67	Established	257	Python
3	pguso/agents-from-scratch Build AI agents from first principles using a local LLM - no frameworks, no...	58	Established	593	Python
4	samholt/L2MAC 🚀 The LLM Automatic Computer Framework: L2MAC	56	Established	146	Python
5	pguso/ai-agents-from-scratch Demystify AI agents by building them yourself. Local LLMs, no black boxes,...	55	Established	3,283	JavaScript
6	mnfst/awesome-free-llm-apis Permanent Free LLM API List (API Keys) 😎🔑	54	Established	1,056	—
7	wjayesh/mahilo mahilo: Multi-Agent Human-in-the-Loop Framework is a flexible framework for...	53	Established	470	Python
8	sigoden/llm-functions Easily create LLM tools and agents using plain Bash/JavaScript/Python functions.	52	Established	717	Shell
9	i365dev/llm_agent An abstraction library for building domain-specific intelligent agents based...	49	Emerging	27	Elixir
10	christianheine/jorel LLMs made easy: Multiple providers, images, documents, tools, and agents in...	48	Emerging	5	TypeScript
11	aniketmaurya/Agents Build Agentic workflows with function calling using open LLMs	45	Emerging	28	Python
12	MVPandey/DTS 🌳 MCTS-inspired parallel beam search for conversation optimization....	45	Emerging	35	Python
13	PathOnAIOrg/LiteWebAgent [NAACL2025] LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications	45	Emerging	146	Python
14	PathOnAIOrg/LiteMultiAgent The Library for LLM-based multi-agent applications	43	Emerging	102	Python
15	AgnostiqHQ/multi-agent-llm Lean implementation of various multi-agent LLM methods, including Iteration...	42	Emerging	128	Python
16	NKAI-Decision-Team/LLM-PySC2 LLM-PySC2 is NKAI Decision Team and NUDT Decision Team's Python component of...	41	Emerging	152	Python
17	Pravko-Solutions/FlashLearn Integrate LLM in any pipeline - fit/predict pattern, JSON driven flows, and...	40	Emerging	608	Python
18	rubra-ai/rubra Open Weight, tool-calling LLMs	40	Emerging	155	Makefile
19	kenshiro-o/nagato-ai Simple cross-LLM AI Agent library	39	Emerging	118	Python
20	AliNajafi1998/ComStream In this project, we implemented a topic detection system on Twitter. This...	39	Emerging	26	Python
21	pengshuang/Awesome-Agent-Projects Fun LLM Agent Projects I Designed & Built	39	Emerging	52	Python
22	ARPAHLS/rooms A secure, local-first Python framework for orchestrating complex multi-agent...	39	Emerging	8	Python
23	askmanu/acorn LLM framework for long running agents	39	Emerging	7	Python
24	Rovanta/rmodel rModel is a framework for building LLM applications with agentic workflow	39	Emerging	66	Go
25	Das-rebel/tmlpd-skill TMLPD v3.0 - Production-Grade AI Agent Platform with Self-Healing Parallel...	38	Emerging	3	Python
26	Aquiles-ai/Ishikawa-Toolkit Extensible framework for creating and managing LLM function calling.	38	Emerging	1	TypeScript
27	diegovelilla/FreeThinker FreeThinker is an AI agent that uses free-of-charge API open source LLMs in...	38	Emerging	85	Python
28	Shrest4647/awesome-llm-app-ideas A curative list of app ideas that you can implement using the Large Language Models.	38	Emerging	12	—
29	jtdowney/starlet An LLM interaction library that makes you feel like a star	38	Emerging	1	Gleam
30	ShunsukeHayashi/swml-agent Physics-based coding agent. Minimizing action in Omega-space. S =...	37	Emerging	3	Python
31	iBz-04/raya llm agent that controls your computer	36	Emerging	27	Python
32	RamboRogers/cyber-inference Cyber-Inference is a web GUI management tool for running OpenAI-compatible...	35	Emerging	10	Python
33	bin123apple/MACM [NeurIPS 2024] MACM: Utilizing a Multi-Agent System for Condition Mining in...	35	Emerging	92	Python
34	AlbanPerli/Noema-Declarative-AI A declarative way to control LLMs.	35	Emerging	80	Python
35	Jeomon/Meta-Agent-with-More-Agents The purpose of the "Meta Agent with More Agents" project is to dynamically...	33	Emerging	43	Jupyter Notebook
36	balakhonoff/ai42z ai42z is an innovative framework designed to transform Large Language Models...	33	Emerging	37	Python
37	Masao-Taketani/AI-Scientist-with-Local-LLMs The AI Scientist backed up by local LLMs	33	Emerging	6	TeX
38	ayushchaware08/multi_agent_system multi-agent AI system that intelligently routes user queries to specialized...	33	Emerging	1	Python
39	RAIL-Suite/RAIL Remote Agent Invocation Layer	32	Emerging	13	C++
40	Yutarop/turtlebot3_agent Control TurtleBot3 with natural language using LLMs	32	Emerging	19	Python
41	Yutarop/turtlesim_agent Draw with LLMs in ROS2 TurtleSim	31	Emerging	28	Python
42	kjannette/kongruity_ kongruity leverages LLMs and cohesion scoring to transform unstructured...	31	Emerging	184	JavaScript
43	GlyphyAI/liteswarm Lightweight Agent Framework for building AI apps with any LLM	29	Experimental	5	Python
44	voidborne-d/lambda-lang Λ — Minimal agent-to-agent communication language	29	Experimental	5	Python
45	mozilla/fm4se-lab A collaborative repository for experiments and research on Foundation Models...	29	Experimental	2	Python
46	The-Swarm-Corporation/DPO-MCTS-ToT-Training This module implements a post-training mechanism that allows a language...	28	Experimental	8	Python
47	B-A-M-N/SynapticLlamas Distributed Multi-Agent AI Orchestration with Ollama - Advanced...	28	Experimental	3	Python
48	aritraroy24/the-fullerene-factory Repository of Team "The Fullerene Factory" for 2025 LLM Hackathon for...	28	Experimental	1	Python
49	ArneJanning/local-skills-agent Self-extending AI agent system running on local Ollama - creates its own...	28	Experimental	11	Python
50	bowen-upenn/Multi-Agent-VQA [CVPR 2024 CVinW] Multi-Agent VQA: Exploring Multi-Agent Foundation Models...	27	Experimental	20	Python
51	Maryam-Nasseri/MoA-local A simplified agentic workflow process based on the Mixture of Agents (MoA)...	27	Experimental	6	Python
52	SOCIALPINE/ergodic-pipeline Multi-agent AI pipeline that transforms random noise into emergent research...	26	Experimental	7	Python
53	zmzubraj/APOLLO_Gov_Proposal_System APOLLO is a comprehensive governance automation framework that leverages...	25	Experimental	—	Python
54	acblabs/multi_llm A cost-aware, multi-LLM routing agent using Gemini as the default and...	25	Experimental	3	Python
55	MahmoudHussienMohamed/Agentic-Network-Monitoring Agentic Network Monitoring: An autonomous multi-agent SOC system powered by...	25	Experimental	6	Python
56	saadsh15/ai_council A terminal-based multi-agent AI research platform that orchestrates local...	24	Experimental	—	Python
57	TommyOh0428/Multiagent-Bot A Multiagent Discord bot that utilize Large Language Model (LLM) and hosted...	24	Experimental	2	Python
58	hexanomicon/lychd An LLM-animated daemon bound to Systemd. Forges intelligent agents using...	24	Experimental	1	Python
59	yhlchat-dev/ai-agent-system Modular AI agent with memory, task scheduling, and tool integration capabilities.	23	Experimental	1	Python
60	Evidion-AI/EvidionAI Autonomous multi-agent AI research system	23	Experimental	1	Python
61	okhmat-anton/babber Agents server for home LLM	23	Experimental	1	Python
62	okhmat-anton/ai-agents-server Agents server for home LLM	23	Experimental	1	Python
63	BharkaviPM/local-search-ai-agent Fully local autonomous AI research agent using Ollama with tool-based web...	23	Experimental	—	Python
64	Devgoodcode/ideal-ai One Connector to Rule Them All. The ultimate Open Source Python LLM...	23	Experimental	—	Python
65	NullRabbitLabs/llm-gateway Multi-provider LLM gateway with automatic fallback and cost tracking. Single...	23	Experimental	2	Python
66	muhammadhussain-2009/Open-Source-LLM-Projects Locally Hosted LLM Projects. AI agent projects included as well	22	Experimental	—	Python
67	baekenough/clau-doom LLM-orchestrated multi-agent DOOM AI: RAG experience accumulation + DOE...	22	Experimental	1	Python
68	T-Sunm/VMARC-QA Official implementation of 'A knowledge-based Multi-agent approach for...	22	Experimental	9	Jupyter Notebook
69	thematic-blacksea501/llm-council-master-free Deliver robust AI model failover chains with free-tier APIs for scalable,...	22	Experimental	—	Python
70	ronit111/showntell Frame extraction toolkit for LLM agents. Transcripts capture what was said;...	22	Experimental	—	Python
71	eason-tien/arcmind 🧠 OODA-based autonomous AI Agent — multi-provider LLM routing, 63 skills,...	22	Experimental	—	Python
72	SJ9VRF/Multi-Agent-LLM Multi-agent LLM project using LlamaIndex for document-specific QA,...	22	Experimental	2	Python
73	contactjccoaching-wq/spinal-loop Bio-inspired multi-agent orchestration — 4 neuromuscular mechanisms for...	22	Experimental	1	Python
74	hunterooc/bootstrap-basil Training a small language model from random weights, using curriculum-driven...	21	Experimental	—	Python
75	techravish/cleverlabs-llm-suite A curated collection of LLM-powered applications, AI agents, and GenAI...	21	Experimental	—	Jupyter Notebook
76	yashk1103/ArcSys Multi-Agent System for developing Backend Architectures	21	Experimental	—	Python
77	Seraphiel102/sovereign-dev-team 9-agent AI development team running 100% locally with Ollama	21	Experimental	—	Python
78	m3dcodie/LLM-Capability-Framework-LCF Precision-Matched Intelligence. The LLM Capability Framework (LCF) is a...	21	Experimental	—	—
79	jstilb/compound-ai-system Multi-model router with intelligent routing, cost tracking, quality...	21	Experimental	—	Python
80	Lay4U/build-your-own-ai-agent 12 practical projects to master AI agents from scratch. No frameworks, no...	21	Experimental	—	Python
81	ellmos-ai/rinnsal Lightweight LLM agent infrastructure: Memory, Connectors, Automation....	21	Experimental	—	Python
82	devXjitin/autourgos-llmkit Autourgos LLMKit is a lightweight toolkit that unifies access to multiple...	21	Experimental	—	Python
83	LoremHug/A-0 A₀-stabilized generation regime for LLMs. A₀ does not select paths. It...	21	Experimental	—	—
84	humbertogontijo/bullmq-ai-agent Scalable AI agent orchestration with BullMQ and LangChain. Define goals and...	21	Experimental	—	TypeScript
85	Antonio-Tresol/agents A very simple agent framework for LLM-based agents research, as...	21	Experimental	—	Python
86	hunyadi/function_tool Universal wrapper for Python functions to be used with LLM function calling	21	Experimental	—	Python
87	DandaAkhilReddy/Amazing_LLM_Apps Curated collection of LLM apps built with RAG, AI Agents, Multi-agent Teams,...	21	Experimental	—	Python
88	minkaungmon430/ollama-multi-agent-roleplay Simple yet powerful multi-agent framework using Ollama and local LLMs....	21	Experimental	—	Python
89	mdShakil2004/LLM-projects-Store LLM Projects Store , production-ready LLM applications built using RAG, AI...	21	Experimental	—	Python
90	alo-genesis/ALO-RKA-CIS A design framework for controlling LLMs via Abstract Language Objects (ALO)...	21	Experimental	—	—
91	eliacharfe/llm-projects Applied LLM engineering experiments including RAG, vector search, LangChain...	21	Experimental	—	Python
92	Hemanth2890/Autonomous-ML-Agent Imbalance-aware Multi-Agent AutoML system with cross-validated macro-F1...	21	Experimental	—	Python
93	marrakechinmorocco/sktk Simplify building Python LLM agents with a unified API, guardrails,...	21	Experimental	—	Python
94	richstokes/multi-llama 🧠🦙 Multi-agent local LLM orchestrator, powered by ollama	20	Experimental	1	Python
95	muthuks2020/reasona AI Agent Orchestration Framework Context engineering, multi-agent...	20	Experimental	1	Python
96	Octaaaaa/agentic-ai-framework Framework for building multi-agent AI systems with LangGraph orchestration	20	Experimental	1	Python
97	melo-maniac-29/orbital-agent-framework Local-first agent framework for building tool-using LLM workflows with LangGraph	19	Experimental	—	Python
98	ranfysvalle02/vanilla-agents This repository provides a flexible and customizable implementation of an...	19	Experimental	12	Python
99	Masao-Taketani/LocalAgentLaboratory This repository accommodates local LLMs for Agent Laboratory, with which you...	18	Experimental	2	Python
100	maiglesi/llmx LLMX - A token-efficient protocol for inter-LLM communication. Enables...	17	Experimental	—	Shell
101	mhattingpete/llm-agents A repository for easy setup of LLM powered autonomous agents	17	Experimental	1	Python
102	louislin520/tianji-decision-engine Deterministic time-based stochastic signal API for AI Agents. Inject...	17	Experimental	—	Python
103	fvilmos/AI_ReAct_agent Implements a Reasoning and Acting AI agent with local LLM and tools usage in Python.	17	Experimental	1	Python
104	UTSAVS26/DungeonLM DungeonLM is a language model-powered agent designed for navigating and...	16	Experimental	3	Python
105	yangyh-2025/moral-realism 大语言模型驱动的基于阎学通的道义现实主义理论的国际关系主体基建模（ABM）研究平台。 LLM-Driven Agent-Based Modeling...	15	Experimental	1	Python
106	phucsystem/llm-project-proposal-generation-agent LLM agent for automated project proposal generation	14	Experimental	1	—
107	pulkitpareek18/mvm2 Multi-LLM Math Verification System — Solves math using 5 AI models...	14	Experimental	—	Python
108	ritheesh-dev/Autonomous-Tool-Calling-Agent Autonomous AI agent built from scratch using Ollama + Mistral — dynamic tool...	14	Experimental	—	Python
109	Diomandeee/cognitive-twin User pattern learning with trajectory-aware DPO training for conversational AI	14	Experimental	—	Python
110	yeukfei02/multi-llm-agent multi-llm-agent	13	Experimental	—	Python
111	stable-reasoning/ai4materials Enhancing the reasoning of LLMs in materials discovery. MSc project at I-X,...	13	Experimental	—	Jupyter Notebook
112	0DevDutt0/multi-agent-ai-orchestration-system Production-ready multi-agent AI orchestration system using LangChain that...	13	Experimental	—	Python
113	Bala-vikram8/LLM-Router Smart LLM routing that sends each query to the cheapest model that can...	13	Experimental	—	Python
114	janneesa/sena SENA is a synchronous state-machine AI agent project built with Python and Ollama.	13	Experimental	—	Python
115	DhruvrajSinhZala24/internship-task-multiagent A modular multi-agent AI system that classifies and routes documents (Email,...	13	Experimental	—	Python
116	LiteObject/multi-agent-research A multi-agent research framework leveraging LLMs to explore collaborative AI...	13	Experimental	—	Python
117	BesmirQerosi/local-ai-agent A fully autonomous, local AI Agent built with React, FastAPI, LangGraph &...	13	Experimental	—	Python
118	kishoretvk/jsonAI jsonAI, a open-source Python library designed to address the common...	13	Experimental	—	Python
119	m3mentomor1/Input-based-LLM-Routing-Agent A dynamic input-based LLM routing AI-agent built with n8n. It selects the...	13	Experimental	—	—
120	Biodyn-AI/mi-workbench Autonomous multi-agent platform for mechanistic interpretability research	13	Experimental	—	Python
121	gradrix/dendrite 🧠 Self-organizing AI agent with dendrite spawning - decomposes complex goals...	13	Experimental	—	Python
122	sohaibzafar701/RoboLinguist Production-ready system enabling intuitive robot fleet control through...	13	Experimental	—	Python
123	BarathKV/VectorRoute A Simple Vector embedding based routing standard/policy for LLM Tools and...	13	Experimental	—	Python
124	sametsenturka/llm-agent-dev Includes multiple agents: File Manager, Finance, Search, and Teach Agent,...	13	Experimental	3	Python
125	Darakhsh1999/ollama-agents Agentic framework implemented exclusively around Ollama models.	11	Experimental	—	Python
126	pradeepiyer/ray-agent AI Agents for Ray: ask ray questions, analyze for resource requrements,...	11	Experimental	—	Python
127	dave-nachman/agent-steps LLM agent workflows without a DSL	11	Experimental	—	Python
128	belokolek/ai-agents-diagram A collection of autonomous agents powered by LLM.	11	Experimental	2	—
129	M-MuneebAlam/multi-agent-llm-app Multi-agent LLM application featuring a simple chatbot, internet...	10	Experimental	1	Python
130	aygp-dr/llm-function-actors Two-actor pattern implementation for LLM function calling in Guile Scheme....	10	Experimental	1	Scheme

Comparisons in this category

agents-from-scratch and ai-agents-from-scratch (58 vs 55)