Local LLM Integration MCP Servers

Tools for integrating and running local LLMs (via Ollama, llama-cpp, etc.) as MCP servers or clients, enabling local inference and tool chaining. Does NOT include cloud-based LLM providers, LLM fine-tuning frameworks, or general LLM SDKs without MCP integration.

There are 69 local llm integration servers tracked. 5 score above 50 (established tier). The highest-rated is jonigl/mcp-client-for-ollama at 67/100 with 563 stars. 2 of the top 10 are actively maintained.

Get all 69 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=mcp&subcategory=local-llm-integration&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Server	Score	Tier	Stars	Language
1	jonigl/mcp-client-for-ollama A text-based user interface (TUI) client for interacting with MCP servers...	67	Established	563	Python
2	ArcadeAI/arcade-mcp The best way to create, deploy, and share MCP Servers	61	Established	824	Python
3	Dicklesworthstone/ultimate_mcp_server Comprehensive MCP server exposing dozens of capabilities to AI agents:...	55	Established	143	Python
4	hmldns/nautex MCP server for guiding Coding Agents via end-to-end requirements to...	54	Established	70	Python
5	SecretiveShell/MCP-Bridge A middleware to provide an openAI compatible endpoint that can call MCP tools	52	Established	920	Python
6	possible055/relace-mcp Unofficial Relace MCP client with AI features. Personal project; not...	49	Emerging	27	Python
7	habedi/omni-lpr A multi-interface (REST and MCP) server for automatic license plate recognition 🚗	47	Emerging	22	Python
8	run-llama/mcp-server-llamacloud A MCP server connecting to managed indexes on LlamaCloud	46	Emerging	86	JavaScript
9	CogitatorTech/omni-nli A multi-interface (REST and MCP) server for natural language inference	45	Emerging	3	Python
10	zinja-coder/zin-mcp-client MCP Client which serves as bridge between mcp servers and local LLMs running...	43	Emerging	99	Python
11	clanker-lover/spicebridge MCP server that gives AI assistants direct access to ngspice circuit...	42	Emerging	8	Python
12	larsenweigle/langextract-mcp FastMCP for Google's langextract library	41	Emerging	28	Python
13	fungiboletus/mcp_cafe Professional and useful coffee breaks for AI agents	39	Emerging	6	Python
14	pblagoje/mcp-ollama-python Ollama MCP Server, let's you chat with your local LLM running on your local...	38	Emerging	1	Python
15	mytechnotalent/Local_MCP_Client Local MCP Client is a cross-platform web and API interface for interacting...	37	Emerging	5	Python
16	arjunprabhulal/mcp-llama3-client A client for the MCP Flight Search service using Ollama and Llama 3.2 to...	37	Emerging	9	Python
17	Damien829/aipaygen Open-source MCP server with 250+ AI tools. Research, code, scrape,...	37	Emerging	1	Python
18	AuraFriday/llm_mcp MCP server that runs local LLMs (with full access to MCP tools included)....	36	Emerging	1	Python
19	siliconsociety/FortunaMCP FortunaMCP is an advanced MCP server dedicated to generating high-quality...	36	Emerging	5	Python
20	OpenAdaptAI/OmniMCP OmniMCP uses Microsoft OmniParser and Model Context Protocol (MCP) to...	35	Emerging	71	Python
21	lmwilki/civ6-mcp An MCP server that lets LLM agents play Civilization VI.	35	Emerging	6	Python
22	thpeng/lokis-mcp Lokis MCP Server will trick your LLM	35	Emerging	2	Java
23	KishinInfoSec/ollama-agent-cli A powerful command-line tool for interacting with Ollama models as a...	35	Emerging	5	Python
24	flothjl/langtools-mcp Supercharge AI agents with programming language tools	34	Emerging	3	Python
25	aiperceivable/apcore-mcp-python Automatic MCP Server & OpenAI Tools Bridge for apcore.	33	Emerging	1	Python
26	castlebbs/gradio-mcp-hackathon Our participation to the 2025 Gradio Agent MCP Hackathon	33	Emerging	13	Python
27	angrysky56/ai_writers_workshop A Model Context Protocol server that provides narrative, character, and...	31	Emerging	2	Python
28	juliensimon/gradio-mcp-server-builder A CLI tool to create MCP (Model Context Protocol) servers with Gradio web...	31	Emerging	2	Python
29	kirillsaidov/ollama-mcp-example Ollama MCP example for dummies.	29	Experimental	10	Python
30	yanmxa/litemcp A minimal, lightweight client designed to simplify SDK adoption into MCP	29	Experimental	7	Python
31	Octid-io/cloudless-sky OSMP — Octid Semantic Mesh Protocol. Agentic AI instruction encoding for any channel.	25	Experimental	3	Python
32	angrysky56/ollama-mcp-server Use fast-agent to use MCP tools with local LLM, API or Claude Desktop. WIP	25	Experimental	5	Python
33	BerriAI/litellm-agent-mcp MCP server giving AI agents access to 100+ LLMs through LiteLLM	24	Experimental	3	Python
34	RomiconEZ/llamator-mcp-server MCP server for llamator: automate LLM red teaming workflows	24	Experimental	4	Python
35	corpollc/corpo-mcp MCP server for AI agent entity formation — sandbox for Wyoming DAO LLC...	22	Experimental	—	Python
36	virbahu/mcp-sc-integration Model Context Protocol integration for supply chain AI agents	22	Experimental	—	Python
37	TECHKNOWMAD-LABS/techknowmad-mcp 8 MCP servers for the AI agent ecosystem.	22	Experimental	—	Python
38	arjunprabhulal/ai-boutique-assit-mcp-client Model Context Protocol (MCP) Client for Online Boutique AI Assistant GKE10...	22	Experimental	1	Python
39	geminixandroid/simple-mcp-ollama-server MCP server with ollama	22	Experimental	1	Python
40	richard-luc/KiCAD-Schematic-Manipulation MCP server that enables AI agents to create, modify, and analyze KiCAD...	22	Experimental	—	Python
41	fitchmultz/cloop Local-first loop/task and knowledge assistant with web UI, CLI, FastAPI,...	21	Experimental	—	Python
42	jaspertvdm/RABEL 🧠 RABEL - MCP Server for AI-to-AI communication. I-Poll messaging, AINS...	21	Experimental	—	Python
43	kyle122497/llamator-mcp-server 🚀 Automate LLM red teaming workflows with the MCP server for LLAMATOR,...	21	Experimental	—	Python
44	gsmMu7ammed/anythingllm-mcp Manage and operate AnythingLLM workspaces, chats, documents, and vectors...	21	Experimental	—	Python
45	jibbs1703/Retail-Chat-Agent-MCP This repository contains the scripts to build and deploy the Model Context...	21	Experimental	—	Python
46	vladimiracunadev-create/mcp-ollama-local MCP + Ollama local: FastAPI web con chat, tools MCP (sandbox) e historial SQLite.	19	Experimental	—	HTML
47	aiperceivable/apcore-mcp Automatic MCP Server & OpenAI Tools Bridge for apcore.	19	Experimental	3	—
48	sandeepnmenon/py_bazel_mcp Integrate Bazel with AI coding assistants via the Model Context Protocol	18	Experimental	1	Python
49	angrysky56/hybrid-ai-mcp Bridges the "black box" problem by creating a formal, inspectable decision...	18	Experimental	1	Python
50	lukasmki/llamacpp-mcp An MCP (Model Context Protocol) wrapper for running local LLMs using llama-cpp-python	17	Experimental	—	Python
51	aipartnerup/apcore-mcp Automatic MCP Server & OpenAI Tools Bridge for apcore.	16	Experimental	3	—
52	ParthaPRay/Ollama_MCP_Gradio This repo presents MCP server for localized Ollama using Gradio	15	Experimental	—	Python
53	LiteObject/llamaindex-mcp-server MCP server that provides LlamaIndex documentation access through Docker	14	Experimental	1	Python
54	aipartnerup/apcore-mcp-python Automatic MCP Server & OpenAI Tools Bridge for apcore.	14	Experimental	1	Python
55	AD-Archer/internal-ai-bridge-mcp A generic MCP and AI server that allows for a connection with an internal AI...	13	Experimental	2	Python
56	nathishdev-netizen/MCP-Factory AI-powered platform that turns natural language into fully functional MCP...	13	Experimental	—	Python
57	tivaliy/mcp-nlp MCP-NLP is a FastMCP application designed to provide NLP (Natural Language...	13	Experimental	—	Python
58	salog0d/UrbanPlannerMCP Acts as the communication layer between the AI components and the FastAPI...	13	Experimental	—	Python
59	krampus-nuggets/panopticon Integrate local LLMs into your codebase. Save on tokens/cost + Always...	13	Experimental	—	Python
60	Vignesh010101/llamaindex-mcp Build your own Local MCP Client with LlamaIndex	13	Experimental	—	Jupyter Notebook
61	arjunprabhulal/ai-boutique-assit-mcp Model Context Protocol (MCP) Server for Online Boutique AI Assistant GKE10...	13	Experimental	—	Python
62	mo1998/NerA A native Arabic intelligence layer and MCP server providing dialect...	13	Experimental	—	Python
63	CSGA-GLOBAL/cobol-bridge COBOL Bridge MCP Server - AI Governance for Legacy Mainframes. Connect 220B...	13	Experimental	—	HTML
64	nim444/mcp-ingest 🚧 This project is currently under development 🚧	13	Experimental	—	Python
65	marc-shade/coral-tpu-mcp Coral TPU MCP Server - Fast local ML inference for agentic systems	13	Experimental	—	Python
66	riteshgharat/oange-cli Powerful multi-IDE automation and orchestration tool that connects AI agents...	13	Experimental	—	Python
67	marc-shade/agi-mcp Status: Production Ready	13	Experimental	—	Python
68	MSKazemi/mcp-zenodo Tool-based LLM integration with Zenodo via the Model Context Protocol (MCP)	12	Experimental	4	Python
69	sriramkreddy10/mcp_server This MCP Server is a lightweight, production-ready backend built with...	12	Experimental	4	Python

Comparisons in this category

mcp-client-for-ollama and zin-mcp-client (67 vs 43) mcp-client-for-ollama and mcp-llama3-client (67 vs 37) mcp-client-for-ollama and Local_MCP_Client (67 vs 37) mcp-client-for-ollama and ollama-agent-cli (67 vs 35) mcp-client-for-ollama and mcp-ollama-python (67 vs 38) zin-mcp-client and Local_MCP_Client (43 vs 37) mcp-ollama-python and Local_MCP_Client (38 vs 37)