victordibia/llmx
An API for Chat Fine-Tuned Large Language Models (llm)
This project provides a single, consistent way to work with various chat-optimized large language models from providers like OpenAI, Google PaLM, and Cohere, or even local HuggingFace models. You input conversational prompts (like a chat history) and receive natural language responses. It's designed for developers building applications that integrate multiple LLMs.
Used by 3 other packages. No commits in the last 6 months. Available on PyPI.
Use this if you are a developer building an application that needs to seamlessly switch between or integrate different chat-tuned large language models without rewriting your code for each one.
Not ideal if you need fine-grained control over how prompts are constructed for each model or if you require advanced inference optimization for self-hosted large language models.
Stars
92
Forks
49
Language
Python
License
MIT
Category
Last pushed
Aug 08, 2024
Commits (30d)
0
Dependencies
8
Reverse dependents
3
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/victordibia/llmx"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
AlexsJones/llmfit
Hundreds of models & providers. One command to find what runs on your hardware.
Chen-zexi/vllm-cli
A command-line interface tool for serving LLM using vLLM.
InftyAI/llmaz
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
livehl/aimirror
🚀 200倍速！AI时代的下载神器 | Docker/PyPI/HuggingFace/CRAN 全加速 | 并行分片+智能缓存，让下载飞起来
TakatoHonda/sui-lang
粋 (Sui) - A programming language optimized for LLM code generation