LLM API Gateways LLM Tools

Gateway and proxy solutions that route requests across multiple LLM providers with features like load balancing, cost tracking, authentication, and failover. Does NOT include SDK wrappers, client libraries, or application-level orchestration frameworks.

There are 248 llm api gateways tools tracked. 2 score above 70 (verified tier). The highest-rated is BerriAI/litellm at 85/100 with 38,910 stars. 7 of the top 10 are actively maintained.

Get all 248 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=llm-api-gateways&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	BerriAI/litellm Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or...	85	Verified	38,910	Python
2	vava-nessa/free-coding-models Find, benchmark and install in CLI 158 FREE coding LLM models across 20...	78	Verified	547	JavaScript
3	envoyproxy/ai-gateway Manages Unified Access to Generative AI Services built on Envoy Gateway	69	Established	1,428	Go
4	theopenco/llmgateway Route, manage, and analyze your LLM requests across multiple providers with...	68	Established	948	TypeScript
5	Portkey-AI/gateway A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs,...	67	Established	10,885	TypeScript
6	intentee/paddler Open-source LLM load balancer and serving platform for self-hosting LLMs at...	64	Established	1,478	Rust
7	AIGNE-io/aigne-hub AIGNE Hub is the default multi-provider LLM/GPT adapter and API key usage...	61	Established	180	TypeScript
8	KenyonY/openai-forward 🚀 大语言模型高效转发服务 · An efficient forwarding service designed for LLMs. · ...	60	Established	988	Python
9	jason5ng32/MyIP The best IP Toolbox. Easy to check what's your IPs, IP geolocation, check...	59	Established	9,940	Vue
10	coaidev/coai 🚀 Next Generation Multi-tenant AI One-Stop Solution. Builtin Admin & Billing...	58	Established	9,008	TypeScript
11	Mirrowel/LLM-API-Key-Proxy Universal LLM Gateway: One API, every LLM. OpenAI/Anthropic-compatible...	57	Established	418	Python
12	LianjiaTech/bella-openapi Bella...	57	Established	209	Java
13	apache/casbin-gateway Casbin AI & MCP security gateway for HTTP, online demo: https://door.caswaf.com	56	Established	555	Go
14	yonggekkk/x-ui-yg x-ui精简修改版脚本，支持最新的Xhttp传输协议、ENC加密、MLDSA65加密，集成argo固定临时双隧道（可共存）、Psiphon赛风VPN（30...	56	Established	3,577	Shell
15	Nayjest/lm-proxy OpenAI-compatible HTTP LLM proxy / gateway for multi-provider inference...	55	Established	92	Python
16	traceloop/hub High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included	55	Established	172	Rust
17	lightseekorg/smg Shepherd Model Gateway	55	Established	89	Rust
18	mksshare/mksshare.github.io 每日分享免费节点、免费机场、ssr节点、v2ray节点、v2ray订阅、clash节点、clash订阅、shadowrocket订阅、Quantumult...	54	Established	1,343	—
19	abshare/abshare.github.io 每日分享免费节点、免费机场、ssr节点、v2ray节点、v2ray订阅、clash节点、clash订阅、shadowrocket订阅、Quantumult...	53	Established	914	—
20	zhaoweih/Shadowsocks-Tutorial 🐱给小白的Shadowsocks翻墙教程-Easy-to-follow tutorials for beginners on using...	53	Established	2,481	Shell
21	aqstack/mimir mimir is a drop-in proxy that caches LLM API responses using semantic...	53	Established	150	Go
22	etalab-ia/OpenGateLLM An open-source, unified interface for running and managing self-hosted LLMs.	52	Established	142	Python
23	inference-gateway/inference-gateway An open-source, cloud-native, high-performance gateway unifying multiple LLM...	52	Established	104	Go
24	traceloop/go-openllmetry Sister project to OpenLLMetry, but in Go. Open-source observability for your...	51	Established	41	Go
25	TU-Wien-dataLAB/aqueduct Aqueduct is a simple yet fully-featured AI gateway built on top of the...	50	Established	18	Python
26	gitcommitshow/resilient-llm Resilient multi-LLM orchestration with in-built failure handing, rate...	50	Established	30	JavaScript
27	yonggekkk/warp-yg warp多功能一键脚本，支持warp-go与wgcf切换，无限生成warp配置文件，支持升级warp+、warp团队账户，查看VPS本地IP、netfli...	49	Emerging	4,412	Shell
28	dongyubin/Free-AppleId-Serve 2026年3月更新🚀苹果美区账号 APPLE ID🚀免费共享Shadowrocket（小火箭）账号,Quantumult...	49	Emerging	2,713	Python
29	linto-ai/llm-gateway LLM service gateway: define once, call anywhere. Handles chunking, queuing,...	48	Emerging	12	Python
30	Cyclenerd/google-cloud-litellm-proxy 🚅 LiteLLM Proxy for Google Cloud Generative AI	48	Emerging	61	Dockerfile
31	DanOps-1/Xray-VPN-OneClick 🚀 5分钟部署 VLESS+Reality VPN \| 访问 ChatGPT/Claude/Google \| npm CLI 管理工具 \|...	47	Emerging	99	TypeScript
32	jina-ai/reader Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/	47	Emerging	10,191	TypeScript
33	doublewordai/control-layer The world’s fastest AI model gateway (450x less overhead than LiteLLM)....	46	Emerging	53	Rust
34	Helicone/ai-gateway The fastest, lightest, and easiest-to-integrate AI gateway on the market....	46	Emerging	549	Rust
35	AI-Stats/AI-Stats Open-source, OpenAI-compatible AI gateway with health-aware routing,...	46	Emerging	5	TypeScript
36	greynewell/infermux Route inference across LLM providers. Track cost per request.	45	Emerging	89	Go
37	KochC/opencode-llm-proxy Local AI gateway for OpenCode — use any model via OpenAI, Anthropic, or Gemini API	45	Emerging	2	JavaScript
38	ultrasev/llmproxy-vercel 通过 vercel 搭建 LLM API 的反向代理	45	Emerging	52	Python
39	LeenHawk/gproxy gproxy is a Rust-based multi-channel LLM proxy that exposes OpenAI / Claude...	45	Emerging	39	Rust
40	Tanantor/langgate Lightweight AI inference gateway - local model registry & parameter...	45	Emerging	6	Python
41	prince776/LLM-Tor A Privacy Layer For Using Frontier LLMs Anonymously	44	Emerging	10	TypeScript
42	bricks-cloud/BricksLLM 🔒 Enterprise-grade API gateway that helps you monitor and impose cost or...	44	Emerging	1,173	Go
43	tprc1949/cheap-vpn-airport 🚁🚀 2025便宜机场推荐 \| 全网最便宜机场！cheapvpn，快连VPN...	44	Emerging	230	HTML
44	lynxai-team/goinfer Local LLM proxy, DevOps friendly	44	Emerging	9	Go
45	EinStack/glide 🐦 A open blazing-fast simple model gateway for rapid development of...	44	Emerging	158	Go
46	yonggekkk/Replit-Xray Replit容器部署xray代理，支持argo固定隧道与临时隧道，自定义伪装网页，一键五协议共存，支持搭建vless、vmess、trojan、shado...	43	Emerging	879	—
47	AprilNEA/BYOKEY Turn AI subscriptions into standard API endpoints. OpenAI & Anthropic...	42	Emerging	12	Rust
48	ferro-labs/ai-gateway Open-source AI Gateway written in Go, one API for OpenAI, Anthropic,...	42	Emerging	19	Go
49	mlibre/Unified-AI-Router 🚀 Production-ready OpenAI-compatible API server with automatic...	42	Emerging	4	JavaScript
50	Writesonic/GPTRouter Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models...	41	Emerging	456	TypeScript
51	ENTERPILOT/GOModel High-performance AI gateway written in Go - unified OpenAI-compatible API...	41	Emerging	20	Go
52	pborenstein/apantli Lightweight local LLM proxy with SQLite cost tracking & interactive model...	41	Emerging	4	JavaScript
53	usagepanda/proxy Security and compliance proxy for LLM APIs	40	Emerging	51	JavaScript
54	andreimerfu/pllm High-performance LLM Gateway built in Go - OpenAI compatible proxy with...	40	Emerging	14	Go
55	missingstudio/gateway [deprecated] AI Gateway - core infrastructure stack for building...	40	Emerging	160	Go
56	uni-token/core LLM Token Solution for Local AI Agents	39	Emerging	7	Vue
57	matdev83/llm-interactive-proxy Connect any LLM-powered client app, such as a coding agent, to any supported...	39	Emerging	15	Python
58	obirler/LLMProxy LLMProxy is an intelligent large language model backend routing proxy service.	38	Emerging	22	C#
59	ottic-ai/llm-gateway Open-source library built for fast and reliable connections to different...	38	Emerging	7	TypeScript
60	saivedant169/AegisFlow Open-Source AI Gateway + Policy + Observability Control Plane. Route,...	38	Emerging	3	Go
61	voidmind-io/voidllm Privacy-first LLM proxy and AI gateway — load balancing, multi-provider...	37	Emerging	16	Go
62	spoonnotfound/apiflow Modern, Open-Source API Gateway & Proxy For AI Services	37	Emerging	20	TypeScript
63	liangshengyong/LanWan 蓝湾是一个 L2TP/IPsec 服务器测试程序，完全开源永久免费无限流量自带节点无需订阅高速稳定科学上网翻墙梯子VPN软件	37	Emerging	19	C
64	fly-apps/bumblebee-model-harness Minimal Elixir application that can host AI models on Fly.io GPUs and make...	37	Emerging	52	Elixir
65	mkshare3/mkshare3.github.io 每日分享免费节点、免费机场、ssr节点、v2ray节点、v2ray订阅、clash节点、clash订阅、shadowrocket订阅、Quantumult...	37	Emerging	208	—
66	KenyonY/flexllm High-Performance LLM Client for Production Batch processing with checkpoint...	37	Emerging	2	Python
67	0M3REXE/eidolon Eidolon is a high-performance reverse proxy designed to secure Large...	37	Emerging	5	Rust
68	omnidotdev/synapse-gateway 🧠 Orchestrated intelligence (Synapse gateway)	36	Emerging	3	Rust
69	Aaryan-Kapoor/ModelGate-Hackathon 🏆Winning Project \| ModelGate is a contract-aware AI control plane that...	36	Emerging	2	TypeScript
70	bold84/cot_proxy Smart proxy for LLM APIs that enables model-specific parameter control,...	36	Emerging	51	Python
71	Kelpejol/llm-output-stability-gate Pre-execution reliability gate using UQLM for LLM output stability	36	Emerging	9	Python
72	star5o/reverse-check Pure Front-End LLM API Testing Tool	35	Emerging	79	Vue
73	tcsenpai/keyfleur API Keys made beautiful	35	Emerging	68	Python
74	toshare5/toshare5.github.io 每日分享免费节点、免费机场、ssr节点、v2ray节点、v2ray订阅、clash节点、clash订阅、shadowrocket订阅、Quantumult...	34	Emerging	185	—
75	gabotechs/signway Bring the power of pre-signed URLs to your apps. Signway is a gateway for...	33	Emerging	99	Rust
76	Azranus/justmysocks 🔥Just My Socks 🔥2025最新翻墙梯子教程（支持ChatGPT）科学上网	33	Emerging	55	—
77	SAILFISH-PTE-LTD/MetroVPN-Windows Fastest VPN for Streaming,Gaming \| ChatGPT Netflix Disney Hulu Hotstar PUBG	33	Emerging	3	—
78	tprc1949/cheap-vpn-recommendation 🚁🚀 2025机场推荐 \| 全网最便宜机场！cheapvpn，快连VPN...	33	Emerging	82	—
79	COO-LLM/coo-llm-main A high-performance reverse proxy that intelligently distributes requests...	33	Emerging	8	Go
80	PropsAI/proxy Props AI provides this open source proxy for Open AI that allows you to...	33	Emerging	11	Go
81	smxl/500 Quantumult X, Loon, Stash 预配置文件: Apple News 解锁, 去广告, 分流规则, Bing AI, TikTok...	33	Emerging	387	JavaScript
82	ekaone/llm-gate A lightweight state-machine that tracks token counts, prevents "Denial of...	32	Emerging	1	TypeScript
83	newnameformat/custom-proxy-for-janitorai A * very * simple guide to using Deepseek or any other models on Janitor.ai	32	Emerging	6	CSS
84	Cisco-AIXEdge/Cisco-AIXEdge Edge AI on Cisco IOS XE	32	Emerging	4	Go
85	inferret/infer A declarative DSL (domain-specific language) for IDD...	31	Emerging	3	Go
86	abshare3/abshare3.github.io 每日分享免费节点、免费机场、ssr节点、v2ray节点、v2ray订阅、clash节点、clash订阅、shadowrocket订阅、Quantumult...	31	Emerging	205	—
87	jichangbaike/ikuuu iKUUU 官网地址入口与多平台使用指南，包含价格、优惠码和常见问题	31	Emerging	5	—
88	vpngpt/vpngpt.github.io 免费VPN，GPT必要神器，支持V2Ray、vpn、免费机场、无限流量，免费VPN，无限流量！V2Ray节点分享，支持v2ray，clash，小火箭！vp...	31	Emerging	1	HTML
89	nazdridoy/llm-proxy A robust, transparent REST API proxy service for LLM APIs with profile-based...	31	Emerging	2	JavaScript
90	robbyt/llm_proxy AI aware proxy	30	Emerging	19	Go
91	adsorgcn/vpscheck 🛡️...	30	Emerging	5	Shell
92	teilomillet/hapax The reliability layer between your code and LLM providers.	29	Experimental	23	Go
93	garyblankenship/wormhole High-performance, multi-provider LLM SDK for Go. Unified access to OpenAI,...	29	Experimental	5	Go
94	jichangzhu/Dageyun 大哥云官网地址	29	Experimental	36	—
95	nickna/Conduit A unified API gateway for multiple LLM providers with OpenAI-compatible endpoints	29	Experimental	8	C#
96	DatanoiseTV/aigateway Self-hosted AI API gateway with per-client provider config (Gemini, OpenAI,...	29	Experimental	5	Go
97	jmanhype/req_llm_gateway OpenAI-compatible LLM proxy with telemetry and multi-provider routing	29	Experimental	3	Elixir
98	mrexodia/logging-proxy High performance reverse proxy for logging LLM traces (OpenRouter/LiteLLM)	28	Experimental	4	Go
99	accuknox/bifrost-accuknox-integration AccuKnox integration with Bifrost LLM gateway	28	Experimental	1	Go
100	Alorse/llm-proxy Allows any BYOK AI editor or extension, such as Cursor or Continue, to...	28	Experimental	18	TypeScript
101	lennyerik/crawl4ai-proxy A simple proxy server to integrate crawl4ai with OpenWebUI	27	Experimental	19	Go
102	tamntlib/LiteLLM-X-Server-Config A self-hosted LLM proxy service combining LiteLLM and CLIProxyAPI to enable...	27	Experimental	3	Python
103	8monkey-ai/hebo-gateway AI Gateway as a Framework. Full control over models, routing & lifecycle....	27	Experimental	17	TypeScript
104	JawherKl/llm-api-gateway Scalable API gateway that aggregates calls to multiple LLMs (OpenAI, Hugging...	27	Experimental	18	Go
105	inference-gateway/operator This project provides a Kubernetes Operator for managing the lifecycle of...	26	Experimental	1	Go
106	vpontual/llm-traffic-manager A dashboard and proxy server for monitoring and managing a fleet of LLM...	26	Experimental	2	TypeScript
107	B022MC/b022hub Self-hosted AI API gateway fork based on Sub2API, focused on subscription...	26	Experimental	—	Go
108	RealnodeVpn/freevpn_freev2ray 🚀免费节点,🚀免费节点订阅,🚀v2ray免费节点,ssr免费节点订阅,clash免费节点订阅,免费梯子,免费翻墙,免费科学上网,免费ss/v2ray/tr...	26	Experimental	90	—
109	PanJung99/pan-api (开发中) 基于 Java 的高性能多模型调度网关：统一标准接口，旨在集成国内外主流 LLM，支持多 Key 调度、计费与监控。	26	Experimental	3	Java
110	AaronStardust/tizi 天路云，付费翻墙梯子（即VPN），无流量限制，GPT可用，全平台支持（Android / iOS / Windows / MacOS / Linux /...	25	Experimental	153	—
111	thecelestialmismatch/Kaelus.Online Real-time AI Compliance Gateway — Cloudflare for AI traffic. Multi-provider...	25	Experimental	1	TypeScript
112	Jaax-Labs/nimbus-router Nimbus is a zero-dependency local proxy that routes your IDE's AI requests...	25	Experimental	6	TypeScript
113	mcp-tool-shop-org/LeaseGate-Lite A one-tab MAUI control surface and local daemon for throttling AI workloads...	25	Experimental	1	C#
114	hyperpolymath/conative-gating SLM-as-Cerebellum for LLM Policy Enforcement - biologically-inspired GO/NO-GO gating	25	Experimental	2	Rust
115	bigint/raven Unified AI gateway for routing, managing, and monitoring LLM API traffic	25	Experimental	1	TypeScript
116	Temikus/butter A blazingly fast AI proxy gateway.	25	Experimental	3	Go
117	myfinder/AIKeyHive Unified LLM API key management platform	25	Experimental	1	TypeScript
118	systemime/coding-plan-mask 🎭 Mask your Coding Plan API for any AI coding tool - OpenAI-compatible proxy...	24	Experimental	2	Go
119	azerozero/grob High-performance LLM routing proxy — multi-provider failover, DLP/secret...	24	Experimental	4	Rust
120	flexigpt/inference-go A single interface in Go to get inference from multiple llm/ai providers...	24	Experimental	1	Go
121	ihuzaifashoukat/free-ai-router 150+ free AI models across 20+ providers. Groq, Cerebras, NVIDIA and more...	24	Experimental	1	TypeScript
122	crabtalk/crabllm Litellm inspired LLM gateway with cost tracking, guardrails, load balancing...	24	Experimental	2	Rust
123	mlycore/log A high-performance Golang log choice for human.	24	Experimental	1	Go
124	jiedian123com/totorocloud 龙猫云机场评测与最新官网地址	24	Experimental	2	—
125	modelgw/examples Model Gateway examples - The fastest OpenAI GPT API	23	Experimental	3	Java
126	modpotatodotdev/LLMG an llm provider gateway in rust, fully rig compatible	23	Experimental	2	Rust
127	scottxxxxx/cloudzap Open-source LLM API gateway with auth, multi-provider routing, and...	23	Experimental	1	Python
128	felafax/felafax-gateway felafax-gateway is a fast and lightweight proxy for LLMs, written in Rust....	23	Experimental	3	Rust
129	ElliotOne/nl-production-reliability-engineering-ai-apis Deterministic inference gateway for local LLMs with production-grade...	23	Experimental	1	C#
130	eugener/gandalf Lightweight LLM gateway with multi-provider failover, streaming, and native...	23	Experimental	2	Go
131	maxrihter/imago-LLM-marketplace AI Inference Gateway native to TON/Telegram: OpenAI-compatible API, TON...	23	Experimental	1	TypeScript
132	Strato-Ai/Spectre-ai-inference-loadbalancer NGINX-based load balancer for compute offload to multiple AI backends with...	23	Experimental	1	HTML
133	thecelestialmismatch/Kaelus.ai Real-time AI Compliance Gateway — Cloudflare for AI traffic. Multi-provider...	23	Experimental	1	TypeScript
134	stewartpark/private-llm 🔒 Your own private LLM provider with enterprise-grade privacy	23	Experimental	2	Go
135	hkdb/lmgate A high performance authentication and access-control gateway for LLM API backends	23	Experimental	1	Go
136	ideo-mind/oh-my-ai Bun-native LLM proxy runner with automatic key rotation and a live admin panel.	23	Experimental	1	HTML
137	fabriziosalmi/llmproxy Security-first proxy for Large Language Models	23	Experimental	1	Python
138	dellarwalter/ThrottleAI 🚀 Manage API request rates efficiently with ThrottleAI to prevent overload...	22	Experimental	—	TypeScript
139	carmel/gomlx High-Performance AI Model Serving Gateway	22	Experimental	1	Go
140	serle/igentai Distributed system for orchestrating multiple LLM providers with real-time...	22	Experimental	1	Rust
141	vcal-project/ai-firewall OpenAI-compatible LLM gateway that reduces API costs using Redis exact cache...	22	Experimental	—	Rust
142	rickcrawford/tokenomics An OpenAI-compatible reverse proxy you run yourself. It gives you the...	22	Experimental	1	Go
143	adwantg/kvfleet KV-cache-aware intelligent routing for self-hosted and hybrid LLM fleets....	22	Experimental	—	Python
144	specful-ai/sfgateway API gateway and reverse proxy for OpenAI APIs	22	Experimental	15	Go
145	sserada/llm-glass Chrome DevTools for LLM API calls. A local proxy that displays all LLM...	22	Experimental	—	Python
146	modelgw/modelgw Gateway and load balancer to your LLM inference endpoints	22	Experimental	26	TypeScript
147	Luetzen/ai-gateway Provider-agnostic AI gateway for Rust — LM Studio, Anthropic Claude, Google...	22	Experimental	—	Rust
148	evgensoft/ai-proxy Proxy for many LLM-provider with OpenAI like request	22	Experimental	5	Go
149	Xuuuuu04/new-api new-api 社区精简版（非官方），聚焦核心网关能力与可维护性。	22	Experimental	1	Go
150	fazer-ai/langfuse-proxy Lightweight Bun + Elysia proxy for OpenAI-compatible APIs with Langfuse telemetry	22	Experimental	—	TypeScript
151	chziyue/savor LLM Proxy Gateway for OpenClaw	22	Experimental	—	TypeScript
152	gacabartosz/gaca-core Universal AI Bus — 50+ free LLM models from 11 providers with automatic...	22	Experimental	—	TypeScript
153	Maas-Cloud-API/maas-cloud-api Multi-tenant LLM API Management Platform \| Higress + Go + Next.js \| 40+...	22	Experimental	—	TypeScript
154	lu-zhengda/liteoauthllm A lightweight local AI gateway proxy that uses ChatGPT or Claude...	22	Experimental	—	Go
155	hra42/tenantai A minimal, production-ready AI API proxy in Go with per-tenant database...	22	Experimental	—	Go
156	nunoferna/aegis-llm LLMOps API Gateway in Go. Optimizes GenAI workloads with Qdrant semantic...	22	Experimental	—	Go
157	randomvariable/rocm-llamacpp-envoy-ai-gateway-external-processor For routing requests in an AMD based Kubernetes cluster	22	Experimental	1	Go
158	provnai/provnzero A high-performance Zero Data Retention (ZDR) proxy for AI APIs. Zero...	22	Experimental	—	Rust
159	mrostamii/tooti Decentralized AI inference protocol; coordination, routing, and (later)...	22	Experimental	—	Go
160	kzxl/aiproxy_gateway A blazing fast API Gateway Proxy for Local LLMs & OpenAI that caches prompts...	22	Experimental	—	Go
161	zorrofox/llm-apigee Enterprise LLM API gateway on Apigee X: 30+ models (Gemini, Claude, GLM,...	22	Experimental	—	TypeScript
162	mcp-tool-shop-org/ThrottleAI A token-based lease governor for AI calls — small enough to embed anywhere,...	22	Experimental	—	TypeScript
163	Wolk-Inc/wolk-ai-gateway LLM API gateway with cost tracking, routing, guardrails, and provider abstraction.	22	Experimental	—	TypeScript
164	michaelkrauty/llamesh OpenAI-compatible mesh proxy for llama.cpp	22	Experimental	—	Rust
165	kszongic/llm-api-proxy Lightweight proxy server for LLM APIs with rate limiting and key rotation.	22	Experimental	—	TypeScript
166	kawaiirashi/llm-retry Provide retry logic and circuit breaker functionality for C++ applications...	22	Experimental	—	C++
167	stockyard-dev/Stockyard Self-hosted LLM proxy and control plane. 58 middleware modules, 16...	22	Experimental	—	HTML
168	kacf/LLM-Gateway ⚡ LLM Gateway is a zero-config local AI gateway. Run any GGUF model on your...	22	Experimental	1	Go
169	mfinikov/llm-gateway Example of LLM Gateway for high load systems	22	Experimental	1	Go
170	jichangzhu/TotoroCloud 龙猫云机场官网地址	21	Experimental	47	—
171	charmitro/ai-proxy A lightweight proxy for LLM API calls with guardrails, metrics, and...	21	Experimental	3	Go
172	gorusys/llm-stream-gateway Production Go HTTP service: OpenAI-compatible chat completions with SSE,...	21	Experimental	—	Go
173	ScriptSmith/hadrian Open-source AI Gateway, all enterprise features included	21	Experimental	—	Rust
174	Yibeichouxu/ai-gateway 🚀 一个端点，连接所有 AI 模型。OpenAI 兼容 API Gateway，支持 Claude、Gemini、GPT、DeepSeek 等 50+...	21	Experimental	—	TypeScript
175	lipish/xgateway Xgateway Link is a universal LLM proxy service providing seamless access to...	21	Experimental	—	Rust
176	yagna-1/nexusgate Intelligent multi-provider LLM gateway with cost governance, rate limit...	21	Experimental	—	Rust
177	SAitharaju/aura-ai-gateway 🛡️ Blazing-fast observability and budget-tracking proxy for LLMs. Sub-10ms...	21	Experimental	—	Go
178	AsiaOstrich/llm-key-router Lightweight Node.js reverse proxy for managing LLM API key pools with...	21	Experimental	—	JavaScript
179	tamaproject360/pabriktokenx Enterprise-grade OAuth proxy server for AI coding platforms with...	21	Experimental	—	Go
180	natelindev/llm-gateway Production-minded multi-model LLM inference gateway in Go with SSE...	21	Experimental	—	Go
181	mrmushfiq/llm0-gateway-starter LLM gateway starter from LLM0.ai	21	Experimental	—	Go
182	CJianYu/justmysocks Just My Socks科学上网教程	21	Experimental	7	—
183	LachlanM05/neural-gateway Two-Part system for routing requests from the internet to a user's local hardware.	21	Experimental	—	JavaScript
184	oxtx/hapax The reliability layer between your code and LLM providers. Hapax is a...	19	Experimental	2	Go
185	nstankov-bg/oaievals-collector The OAIEvals Collector: A robust, Go-based metric collector for EVALS data....	19	Experimental	3	Go
186	nvsudo/opengates Source-available runtime for filtering inbound through conversation.	19	Experimental	—	Python
187	distira-project/distira DISTIRA — Sovereign AI Context Operating System, reduces token waste before...	19	Experimental	—	Rust
188	EeroEternal/unigateway Scenario-oriented LLM gateway with OpenAI and Anthropic compatibility.	19	Experimental	1	Rust
189	VonSdite/LLM_Proxy ONE API，LLM_Proxy，统一代理，支持请求响应自定义转换。	19	Experimental	4	Python
190	uuvosd/Free-AppleId 🚀免费Shadowrocket账号，小火箭节点，🚀 免费订阅地址，🚀 免费节点，🚀...	18	Experimental	2	—
191	TOMIBABY/freevpn 🌐 Access the internet freely and securely with our versatile VPN, supporting...	18	Experimental	1	—
192	cyberorg/meshtastic2skylines Forward position to skylines to live track your flying machine on skylines,...	18	Experimental	2	—
193	habibi-dev/rust-llm-proxy A fast Rust-based gateway unifying access to multiple LLM providers with...	18	Experimental	3	Rust
194	jichangzhu/FatcatCloud 肥猫云机场官网地址	17	Experimental	38	—
195	xiaoxu123195/GrokToAPI 🚀 Grok AI 的高性能 OpenAI 兼容网关 \| 企业级令牌管理 \| 媒体缓存 \| Go 构建	17	Experimental	—	Go
196	vendetta-osint/the-door-stays-open AI coalition infrastructure for cross-architecture communication....	17	Experimental	—	—
197	WangYihang/LLM-Redactor A transparent egress gateway to redact sensitive credentials and local data...	16	Experimental	1	Go
198	cymoo/llm-gateway An LLM gateway	16	Experimental	2	TypeScript
199	jichangzhu/jfcloud 疾风云官网地址	16	Experimental	16	—
200	jichangzhu/FlyingBird 飞鸟机场官网地址	15	Experimental	9	—
201	jichangzhu/erwan 尔湾云加速器官网地址	15	Experimental	10	—
202	clashdownload/totorocloud 龙猫云机场好用吗？Clash节点推荐	14	Experimental	5	—
203	scuton-technology/llm-gateway Universal LLM proxy — single OpenAI-compatible API for 12 providers with SSE...	14	Experimental	—	Go
204	llmhut/gateway Blazing-fast AI gateway in Go. Sub-millisecond overhead. Zero external...	14	Experimental	1	Go
205	lipish/unigateway A lightweight, high-performance LLM gateway written in Rust. Features OpenAI...	14	Experimental	1	Rust
206	jichangzhu/yangfanyun 扬帆云机场官网地址	14	Experimental	9	—
207	Xrey995/ai-rapi OpenAI-Compatible API Gateway — 48 models, unlimited tokens, fixed price	14	Experimental	—	—
208	cp50/ai-gateway AI inference gateway with intelligent LLM routing, multi-tenant access...	14	Experimental	—	JavaScript
209	Qually5/go-inference-proxy A lightweight, high-concurrency proxy for managing multiple AI model endpoints.	14	Experimental	—	Go
210	dinahthreewheel75/Air.rs Enable fast GPU inference of large language models that exceed GPU memory by...	14	Experimental	—	Rust
211	DDDDDevin/manus-llm-api-gateway 提供一个统一的、可扩展的中间层,用于管理和调用各种大型语言模型(LLM)的API。通过简单的配置,您可以轻松地集成和切换不同的模型提供商,如OpenAI、...	14	Experimental	1	Java
212	jichangzhu/Naiyun 奈云机场官网地址	14	Experimental	19	—
213	jichangbaike/xxfeng 小旋风 (xxfeng) 官网地址入口说明与多平台使用指南，包含套餐详情及订阅导入指引。	13	Experimental	—	—
214	jichangzhu/Kuromis 库洛米机场官网地址	13	Experimental	9	—
215	landry-some/mimir mimir is a drop-in proxy that caches LLM API responses using semantic...	13	Experimental	—	Go
216	thalesfsp/inference Provides building blocks to integrate with AI / LLM providers and built-in,...	13	Experimental	—	Go
217	marouchsail/aigateway Manage and route API requests between applications and multiple LLM...	13	Experimental	—	Go
218	almaz-go/llm-audit-gateway A high-performance Go-based proxy for monitoring, auditing, and securing LLM...	13	Experimental	—	Go
219	amin-tehrani/llm-gate The Control Plane for your LLM API Keys. Manage 30+ providers with one CLI.	13	Experimental	—	Go
220	agoft/neuralbridge.ru Единый OpenAI-совместимый API для доступа к 70+ AI-моделям. Llama, Flux,...	13	Experimental	—	—
221	hrp749492216/llmgateway A lightweight web UI for sending prompts to OpenAI, Claude, Gemini, and...	13	Experimental	—	JavaScript
222	RealnodeVpn/RealNode RealNode官方版本下载 Lantern官方版本下载蓝灯翻墙代理科学上网外网加速器梯子路由 proxy vpn...	13	Experimental	11	—
223	jiedian123com/dageyun 大哥云评测与最新官网地址	13	Experimental	3	—
224	mkrueger12/Glide A Rusty LLM Router	12	Experimental	1	Rust
225	jichangzhu/ssLinks ssLinks官网地址	12	Experimental	6	—
226	clashdownload/dageyun 大哥云好用吗？Clash节点推荐	12	Experimental	2	—
227	clashdownload/jfcloud 疾风云好用吗？Clash节点推荐	12	Experimental	2	—
228	dailijichang/dageyun 大哥云怎么样?	12	Experimental	2	—
229	jiedian123com/erwan 尔湾云加速器评测与最新官网地址	12	Experimental	2	—
230	PatrickKoss/genai-gateway A llm gateway for centralized rate limiting and metrics for OpenAI...	12	Experimental	7	Rust
231	clashdownload/flyingbird 飞鸟机场好用吗？Clash节点推荐	12	Experimental	2	—
232	Noveum/ai-gateway-ts A hyper-efficient, lightweight AI Gateway that provides a unified interface...	11	Experimental	—	TypeScript
233	jichangzhu/MESL MESL机场官网地址	11	Experimental	4	—
234	gpu-bridge/gpu-bridge 26 AI services. One endpoint. POST /run and you are done.	11	Experimental	—	—
235	dailijichang/suyunti 速云梯怎么样?	11	Experimental	1	—
236	dailijichang/flyingbird 飞鸟机场怎么样?	11	Experimental	1	—
237	clashdownload/suyunti 速云梯好用吗？Clash节点推荐	11	Experimental	1	—
238	jiedian123com/flyingbird 飞鸟机场评测与最新官网地址	11	Experimental	1	—
239	jiedian123com/suyunti 速云梯评测与最新官网地址	11	Experimental	1	—
240	dailijichang/totorocloud 龙猫云机场怎么样?	11	Experimental	1	—
241	jiedian123com/jfcloud 疾风云评测与最新官网地址	11	Experimental	1	—
242	dailijichang/erwan 尔湾云加速器怎么样?	11	Experimental	1	—
243	dailijichang/jfcloud 疾风云怎么样?	11	Experimental	1	—
244	jichangzhu/youxincloud 优信云官网地址	10	Experimental	2	—
245	dailijichang/yangfanyun 扬帆云机场怎么样?	10	Experimental	1	—
246	jiedian123com/yangfanyun 扬帆云机场评测与最新官网地址	10	Experimental	1	—
247	clashdownload/yangfanyun 扬帆云机场好用吗？Clash节点推荐	10	Experimental	1	—
248	clashdownload/feijicloud 飞机云好用吗？Clash节点推荐	10	Experimental	2	—

Comparisons in this category

litellm and openai-forward (85 vs 60) litellm and llmgateway (85 vs 68) litellm and LLM-API-Key-Proxy (85 vs 57) litellm and lm-proxy (85 vs 55) ai-gateway and gateway (69 vs 67) llmgateway and gateway (68 vs 67) llmgateway and LLM-API-Key-Proxy (68 vs 57) openai-forward and lm-proxy (60 vs 55) llmgateway and lm-proxy (68 vs 55) LLM-API-Key-Proxy and lm-proxy (57 vs 55)