r2d4/openlm
OpenAI-compatible Python client that can call any LLM
This tool helps software developers integrate various large language models (LLMs) into their applications using a single, consistent interface. You provide text prompts and specify which LLM(s) to use, and it returns generated text responses from those models. This is ideal for developers building applications that need flexible access to different LLMs without rewriting their code for each one.
372 stars. No commits in the last 6 months. Available on PyPI.
Use this if you are a developer building an application that needs to interact with multiple large language models and want a standardized way to do it.
Not ideal if you are not a developer or only need to use a single LLM and are comfortable using its specific client library.
Stars
372
Forks
22
Language
Python
License
MIT
Category
Last pushed
May 19, 2023
Commits (30d)
0
Dependencies
1
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/r2d4/openlm"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
AlexsJones/llmfit
Hundreds of models & providers. One command to find what runs on your hardware.
victordibia/llmx
An API for Chat Fine-Tuned Large Language Models (llm)
Chen-zexi/vllm-cli
A command-line interface tool for serving LLM using vLLM.
InftyAI/llmaz
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
livehl/aimirror
🚀 200倍速！AI时代的下载神器 | Docker/PyPI/HuggingFace/CRAN 全加速 | 并行分片+智能缓存，让下载飞起来