ai-gateway and gateway
These are competitors offering alternative approaches to LLM routing and access control—Portkey-AI provides a managed gateway service with built-in guardrails, while Envoy's offering leverages the Envoy proxy infrastructure for organizations preferring self-hosted gateway solutions.
About ai-gateway
envoyproxy/ai-gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway
This project helps operations engineers and platform architects manage access to Generative AI services. It acts as a unified entry point, taking requests from applications and routing them to various AI providers or self-hosted models. It handles authentication, rate limiting, and optimizes traffic for different LLM inference needs. The output is controlled, secure, and efficient access to AI capabilities for internal applications.
About gateway
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
This tool helps developers and architects manage their interactions with various large language models (LLMs) from a single point. It acts as a central hub for all your AI model requests, accepting standard API calls and intelligently routing them to over 250 different models. The result is more reliable, secure, and performant AI-powered applications, making it ideal for those building and maintaining sophisticated AI systems.
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work