ozanunal0/Prometheus-Gateway
An open-source, security-first LLM Gateway designed to provide a unified, secure, and observable entry point to any Large Language Model.
This gateway helps organizations securely and efficiently manage how their applications interact with Large Language Models (LLMs). It takes requests from your applications, applies security and optimization rules, and then routes them to the correct LLM, providing sanitized responses back. Operations teams, IT security managers, and AI application developers in enterprise settings would use this to ensure secure and cost-effective LLM usage.
No commits in the last 6 months.
Use this if you need to add a layer of security, privacy protection, performance optimization, and observability to your applications' interactions with Large Language Models like OpenAI.
Not ideal if you are a single user experimenting with LLMs and do not require enterprise-grade security, cost management, or detailed monitoring.
Stars
10
Forks
—
Language
Python
License
GPL-3.0
Category
Last pushed
Jul 09, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/generative-ai/ozanunal0/Prometheus-Gateway"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Featured in
Higher-rated alternatives
openvinotoolkit/model_server
A scalable inference server for models optimized with OpenVINO™
madroidmaq/mlx-omni-server
MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically...
NVIDIA-NeMo/Guardrails
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based...
generative-computing/mellea
Mellea is a library for writing generative programs.
rhesis-ai/rhesis
Open-source platform & SDK for testing LLM and agentic apps. Define expected behavior, generate...