majiayu000/litellm-rs
A high-performance AI Gateway written in Rust — call 100+ LLM APIs using OpenAI format
This project helps developers integrate and manage calls to over 100 different large language model (LLM) APIs, like OpenAI, Anthropic, or Google, using a single, unified interface that behaves just like OpenAI's API. It takes your requests for AI model interactions (chat, embeddings, etc.) and routes them efficiently to the chosen provider, returning the model's response. Software engineers building AI-powered applications will find this valuable.
Use this if you are a developer building an application that needs to interact with various AI models and you want to simplify integration, improve performance, and add enterprise features like load balancing and caching.
Not ideal if you only ever plan to use a single LLM provider and don't require high-performance routing, load balancing, or other gateway functionalities.
Stars
33
Forks
6
Language
Rust
License
MIT
Category
Last pushed
Mar 21, 2026
Monthly downloads
163
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/majiayu000/litellm-rs"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
adysec/OllamaR
Ollama负载均衡服务器 | 一款高性能、易配置的开源负载均衡服务器，优化Ollama负载。它能够帮助您提高应用程序的可用性和响应速度，同时确保系统资源的有效利用。
intelligentnode/IntelliNode
Access the latest AI models like ChatGPT, LLaMA, Deepseek, Diffusion, Hugging face, and beyond...
wpydcr/LLM-Kit
🚀WebUI integrated platform for latest LLMs | 各大语言模型的全流程工具 WebUI...
henomis/lingoose
🪿 LinGoose is a Go framework for building awesome AI/LLM applications.
llmapi-io/llmapi-server
Self-host llmapi server, make it really easy for accessing LLMs ! :rocket: