missingstudio/gateway
[deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications
This project helps AI application developers manage their interactions with various large language models (LLMs) from a single point. It takes API requests for AI model inferences and routes them intelligently to over 100 different LLMs and providers, returning the model's response. The primary user is an AI/ML engineer or developer building and deploying production-ready AI applications.
160 stars. No commits in the last 6 months.
Use this if you are building an AI application and need a robust, unified way to integrate with and manage multiple LLM providers, ensuring reliability and future flexibility.
Not ideal if you are a data scientist or researcher exploring LLMs for one-off tasks and do not require a production-grade infrastructure layer.
Stars
160
Forks
17
Language
Go
License
Apache-2.0
Category
Last pushed
Apr 08, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/missingstudio/gateway"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with...
vava-nessa/free-coding-models
Find, benchmark and install in CLI 158 FREE coding LLM models across 20 providers in real time
envoyproxy/ai-gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with...