etalab-ia/OpenGateLLM
An open-source, unified interface for running and managing self-hosted LLMs.
OpenGateLLM helps organizations centralize, secure, and manage access to their self-hosted AI models. It takes your various Generative AI models and provides a single, controlled access point, allowing teams to integrate AI into applications without dealing with individual model infrastructure. This tool is for IT directors, AI/ML operations teams, and data governance officers who need to ensure data privacy and cost control for internal AI use.
142 stars.
Use this if your organization wants to deploy and manage its own AI models securely, maintain full control over sensitive data, and reduce the costs associated with commercial AI APIs.
Not ideal if you primarily use third-party, cloud-hosted AI services and do not have a need to manage self-hosted models or strict data sovereignty requirements.
Stars
142
Forks
19
Language
Python
License
MIT
Category
Last pushed
Mar 12, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/etalab-ia/OpenGateLLM"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with...
vava-nessa/free-coding-models
Find, benchmark and install in CLI 158 FREE coding LLM models across 20 providers in real time
envoyproxy/ai-gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with...