Helicone/ai-gateway
The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.
This tool helps developers and ML engineers manage interactions with multiple Large Language Models (LLMs) from different providers using a single, unified interface. It takes requests using familiar OpenAI syntax, routes them intelligently to the best LLM based on speed, cost, or reliability, and outputs the LLM's response. It's ideal for anyone building applications that rely on various LLM services.
549 stars.
Use this if you are building an AI application and need a robust, performant way to connect to many LLM providers while optimizing for cost, speed, or reliability.
Not ideal if your application only uses a single LLM provider and doesn't require advanced routing, caching, or rate limiting features.
Stars
549
Forks
44
Language
Rust
License
GPL-3.0
Category
Last pushed
Nov 21, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/Helicone/ai-gateway"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with...
vava-nessa/free-coding-models
Find, benchmark and install in CLI 158 FREE coding LLM models across 20 providers in real time
envoyproxy/ai-gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with...