ventz/easy-llms
Easy "1-line" calling of all LLMs from OpenAI, MS Azure, AWS Bedrock, GCP Vertex, and Ollama
This tool simplifies interacting with various Large Language Models (LLMs) from providers like OpenAI, Azure, AWS Bedrock, GCP Vertex, and Ollama. It takes your text prompt as input and returns the LLM's response, letting you quickly switch between different models without dealing with each provider's unique setup. It's ideal for developers or researchers who want to rapidly prototype, compare, or build applications using multiple LLMs.
No commits in the last 6 months. Available on PyPI.
Use this if you need to integrate and switch between many different Large Language Models from various providers without the hassle of learning each one's specific API.
Not ideal if you only ever use one specific LLM from a single provider and do not anticipate needing to switch or compare.
Stars
53
Forks
8
Language
Python
License
MIT
Category
Last pushed
Sep 13, 2024
Commits (30d)
0
Dependencies
7
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/ventz/easy-llms"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
AlexsJones/llmfit
Hundreds of models & providers. One command to find what runs on your hardware.
victordibia/llmx
An API for Chat Fine-Tuned Large Language Models (llm)
Chen-zexi/vllm-cli
A command-line interface tool for serving LLM using vLLM.
InftyAI/llmaz
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
livehl/aimirror
🚀 200倍速！AI时代的下载神器 | Docker/PyPI/HuggingFace/CRAN 全加速 | 并行分片+智能缓存，让下载飞起来