linto-ai/llm-gateway
LLM service gateway: define once, call anywhere. Handles chunking, queuing, retries, token tracking and document export out of the box
This tool helps developers building applications that use Large Language Models (LLMs) to manage complex tasks like summarizing long documents or generating email responses. It takes raw text or documents, processes them reliably using various LLMs, and outputs structured results or summaries without requiring the application developer to handle the intricacies of LLM interactions. It's for developers creating AI-powered features within their software products.
Use this if you are a backend developer building applications that need to reliably process text with LLMs, managing issues like long documents, API rate limits, and job tracking.
Not ideal if you are a data scientist or researcher directly interacting with LLMs for experimentation or one-off tasks without integrating into a larger production application.
Stars
12
Forks
3
Language
Python
License
AGPL-3.0
Category
Last pushed
Mar 23, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/linto-ai/llm-gateway"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with...
vava-nessa/free-coding-models
Find, benchmark and install in CLI 158 FREE coding LLM models across 20 providers in real time
envoyproxy/ai-gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with...