llmgateway and gateway
Both are LLM routing/management gateways with similar core functionality (unified API, multi-provider routing), making them direct competitors for the same use case, though Portkey-AI has significantly more adoption and additional guardrails features.
About llmgateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
This helps developers who build applications using Large Language Models (LLMs) by acting as a central hub for all LLM interactions. It takes your application's LLM requests and routes them to various providers like OpenAI or Anthropic, while also managing API keys, tracking usage, and analyzing performance. Developers can use this to streamline their LLM infrastructure and gain insights into costs and model effectiveness.
About gateway
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
This tool helps developers and architects manage their interactions with various large language models (LLMs) from a single point. It acts as a central hub for all your AI model requests, accepting standard API calls and intelligently routing them to over 250 different models. The result is more reliable, secure, and performant AI-powered applications, making it ideal for those building and maintaining sophisticated AI systems.
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work