LLM Request Routing LLM Tools

Tools for intelligently routing, load-balancing, and directing LLM API requests across multiple providers, models, and inference endpoints. Does NOT include general API gateways, provider SDKs, or agent orchestration frameworks.

There are 63 llm request routing tools tracked. The highest-rated is neuraxes/neurouter at 40/100 with 2 stars.

Get all 63 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=llm-request-routing&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	neuraxes/neurouter A powerful router that provides a unified interface for all upstream LLMs	40	Emerging	2	Go
2	unifyroute/unifyroute Stop being locked into one LLM provider. UnifyRoute is a self-hosted gateway...	40	Emerging	8	Python
3	CarloLepelaars/irouter Access 100s of LLMs with minimal lines of code	39	Emerging	25	Jupyter Notebook
4	deeflect/smart-spawn Intelligent model routing for AI agents. Auto-selects the right LLM per task...	38	Emerging	6	TypeScript
5	peva3/SmarterRouter SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama,...	35	Emerging	63	Python
6	r9s-ai/open-next-router A lightweight, DSL-driven LLM gateway for routing, patching provider quirks,...	32	Emerging	13	Go
7	smarter-sh/smarter Smarter is an extensible AI resource management system	29	Experimental	3	JavaScript
8	loral-labs/magic-carpet Magic Carpet is an open-source LLM router framework. With Magic Carpet,...	29	Experimental	1	Python
9	emingenc/llm_adaptive_router llm_adaptive_router: Given the following query and candidate models, selects...	29	Experimental	6	Python
10	dineshloki2612/barra 🚀 Build REST APIs easily with Barra, a Go toolkit that uses the standard...	27	Experimental	1	—
11	abhi1693/open-llm-router Open-LLM Router is an OpenAI-compatible API gateway that intelligently...	27	Experimental	6	Python
12	zkywsg/ModelConfig Config-driven model routing for multi-provider AI apps.	26	Experimental	2	TypeScript
13	pranabjyotinath1999/llm-switchboard Route prompts to local large language models instantly to cut costs and...	25	Experimental	1	TypeScript
14	slb350/octoroute Smart HTTP router for local LLMs (Ollama, LM Studio, llama.cpp). Rule-based...	25	Experimental	6	Rust
15	XtraVisionsAI/one-router Unified LLM API router — route OpenAI & Anthropic protocols to Bedrock,...	24	Experimental	2	Rust
16	mstfknn/llm-router Minimal LLM routing proxy. Zero dependencies, single binary.	23	Experimental	1	Go
17	BlackRoad-AI/vllm-deployment vllm deployment — Part of the BlackRoad OS ecosystem. Sovereign computing,...	22	Experimental	—	—
18	BlackRoad-OS/blackroad-os-vllm ulackroad os vllm — Part of the BlackRoad OS ecosystem. Sovereign computing,...	22	Experimental	—	HTML
19	BlackRoad-AI/inference-blackroadio ARCHIVED: See BlackRoad-OS/sites for consolidated domain sites	22	Experimental	—	HTML
20	gh1002-ow1/llm-foundation Capability-based LLM routing for application teams, with free/paid tracks,...	22	Experimental	1	JavaScript
21	BlackRoad-Security/security-model.blackroad.io security model.ulackroad.io — Part of the BlackRoad OS ecosystem. Sovereign...	22	Experimental	—	HTML
22	BlackRoad-AI/models.blackroad.io models.ulackroad.io — Part of the BlackRoad OS ecosystem. Sovereign...	22	Experimental	—	HTML
23	BlackRoad-OS/models-blackroad-io models ulackroad io — Part of the BlackRoad OS ecosystem. Sovereign...	22	Experimental	—	HTML
24	yashveerlabs/local-llm-router Auto-detects locally running LLMs and exposes a unified OpenAI-compatible API	22	Experimental	—	TypeScript
25	kidda229/polyroute 🚦Route LLM requests across OpenAI and Anthropic with automatic fallback,...	22	Experimental	—	Python
26	BlackRoad-AI/blackroad-ai-deepseek DeepSeek-V3 AI model deployment for BlackRoad infrastructure (MIT + Custom License)	22	Experimental	—	—
27	BlackRoad-AI/lucidia-ai-models 🧠 Lucidia AI Models Hub - Universal AI model memory and continuity layer...	22	Experimental	—	HTML
28	BlackRoad-OS/blackroad-vllm BlackRoad vLLM for LLM serving	22	Experimental	—	HTML
29	BlackRoad-OS-Inc/blackroad-chat BlackRoad AI Chat — Ollama-powered chat interface	22	Experimental	—	HTML
30	BlackRoad-OS/blackroad-localai BlackRoad-enhanced LocalAI for local inference	22	Experimental	—	HTML
31	BlackRoad-AI/lucidia-ai-models-enhanced 🖤 Enhanced Lucidia AI models with BlackRoad optimizations	22	Experimental	—	HTML
32	wuleiyuan/smart-model-selector 🧠智能模型调度系统 - 基于任务类型自动选择最优 AI 模型，支持多 Provider 负载均衡、故障自动转移、成本优化	22	Experimental	1	Python
33	ZSeven-W/local-llm-router Local AI routing gateway with cost tracking. Proxy...	22	Experimental	1	JavaScript
34	l3ocifer/openferris OpenRouter for local compute. One API to route inference, storage, memory,...	21	Experimental	—	Rust
35	BlackRoad-AI/blackroad-ai-api-gateway Unified API gateway for all BlackRoad AI models with [MEMORY] integration	21	Experimental	—	JavaScript
36	chigwell/routerflu A new package is designed to streamline the interaction with large language...	21	Experimental	1	Python
37	juyterman1000/smartllm-router This is the LLM money saver library for the developers, testers, product...	18	Experimental	1	Python
38	neutrome-labs/open-ai-router Caddy-module implementing multi-provider AI routing	17	Experimental	2	Go
39	nep-0/llm-router A flexible and efficient OpenAI-compatible API router for large language...	17	Experimental	—	Go
40	tumf/kani LLM smart router — classifies prompts by complexity and routes to the...	17	Experimental	4	Python
41	danseb93/filter-free-models-for-open-router Automatically discover, filter, and test free AI models available on...	15	Experimental	2	JavaScript
42	mohsen-ahmed-pm/python-ai-model-router A lightweight Python router for calling multiple AI providers through a...	14	Experimental	1	Jupyter Notebook
43	Meghasukkayapally/rest-gateway-1771916148-2 Provide a RESTful API gateway that manages authentication and enforces rate...	14	Experimental	—	—
44	Aditya0963/modelrelay Route AI coding requests locally to the best free OpenAI-compatible models...	14	Experimental	—	—
45	Fhaz5000/llm-router Route prompts efficiently to appropriate modes for large language models...	14	Experimental	—	HTML
46	faresbenbelkacem/OpenRouterBench 🚀 Benchmark LLM routing with OpenRouterBench, featuring 25+ datasets and...	14	Experimental	—	Python
47	illogical/LMApi LMApi is an intelligent request router and load balancer for Ollama servers.	14	Experimental	—	TypeScript
48	RichardHam-co-uk/LocalLLM-Router-Project Advanced local LLM routing system built with Node.js to offload tasks to...	13	Experimental	—	JavaScript
49	marcossangomes/SmartLLM-Router 🔍 Optimize LLM requests by routing them to the best models, while leveraging...	13	Experimental	—	Jupyter Notebook
50	rishiraj5219/rest-gateway-1771917362-4 Manage API requests with authentication and rate limiting using this RESTful...	13	Experimental	—	HTML
51	michael-bmstu/llm-router A Router component based on LLM that will redirect the user's request to...	13	Experimental	—	Python
52	kellybossman/rest-gateway-1771916158-6 Provide secure RESTful API access with built-in authentication and rate...	13	Experimental	—	—
53	rach390/rest-gateway-1771929895-4 Provide a fast, easy-to-use REST API gateway with high performance and zero...	13	Experimental	—	Go
54	JFPastor09/rest-gateway-1771916756-4 Provide secure RESTful API access with authentication and rate limiting to...	13	Experimental	—	—
55	HitmanCR/rest-gateway-1771917206-3 Provide a RESTful API gateway that manages authentication and controls...	13	Experimental	—	—
56	tatsuki817/llm-router Manage concurrent LLM requests with priority queues, multi-model routing,...	13	Experimental	—	HTML
57	Firmancaaa/rest-gateway-1771916753-3 Provide a RESTful API gateway that manages authentication and enforces rate...	13	Experimental	—	—
58	nkenchor/odyn-go-router High-performance Go (Gin) router for OpenAI-compatible llama.cpp inference,...	13	Experimental	—	Go
59	viniciusfinger/router-agent-benchmark Benchmark AI models to find the best model to use as router agent according...	13	Experimental	2	Jupyter Notebook
60	NABILA2308/routerflu 🚀 Streamline LLM interactions by converting natural inputs into structured,...	13	Experimental	—	Python
61	iamNarcisse/model-router Semantic model router for directing user queries to optimal LLM models based...	12	Experimental	1	Go
62	Chainsmoker23/llm-flow-router Tiny Express-like multiplexer for routing AI prompts to multiple providers...	12	Experimental	1	JavaScript
63	sebastianpinedaar/llumux Compose, train and test fast LLM routers	11	Experimental	1	Python

Comparisons in this category

security-model.blackroad.io and models.blackroad.io (22 vs 22) security-model.blackroad.io and models-blackroad-io (22 vs 22)