Portkey-AI/gateway

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

/ 100

Established

This tool helps developers and architects manage their interactions with various large language models (LLMs) from a single point. It acts as a central hub for all your AI model requests, accepting standard API calls and intelligently routing them to over 250 different models. The result is more reliable, secure, and performant AI-powered applications, making it ideal for those building and maintaining sophisticated AI systems.

10,885 stars. Actively maintained with 3 commits in the last 30 days. Available on npm.

Use this if you are building an AI application that needs to reliably interact with multiple LLMs, prevent downtimes, and ensure secure, scalable operations.

Not ideal if you are only experimenting with a single LLM or do not require advanced features like automatic retries, load balancing, or output guardrails.

AI application development LLM management API routing AI infrastructure model orchestration

Maintenance 13 / 25

Adoption 10 / 25

Maturity 25 / 25

Community 19 / 25

How are scores calculated?

Stars

10,885

Forks

936

Language

TypeScript