xusenlinzy/api-for-open-llm
Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口
This project helps developers integrate various open-source large language models (LLMs) like LLaMA, BLOOM, or Qwen into their applications. It takes input in a standardized format similar to OpenAI's API and outputs model responses, enabling them to power chatbots, generate text, or create embeddings for AI applications. It's for developers building applications that leverage different LLMs and need a consistent way to interact with them.
2,468 stars. No commits in the last 6 months.
Use this if you are a developer building an AI application and want to switch between different open-source large language models or self-trained LORA models using a unified, OpenAI-compatible API.
Not ideal if you are an end-user looking for a ready-to-use chatbot or an application that doesn't require direct LLM integration or customization.
Stars
2,468
Forks
276
Language
Python
License
Apache-2.0
Category
Last pushed
Sep 26, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/xusenlinzy/api-for-open-llm"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
shibing624/MedicalGPT
MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline....
lyogavin/airllm
AirLLM 70B inference with single 4GB GPU
GradientHQ/parallax
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
CrazyBoyM/llama3-Chinese-chat
Llama3、Llama3.1 中文后训练版仓库 - 微调、魔改版本有趣权重 & 训练、推理、评测、部署教程视频 & 文档。
CLUEbenchmark/CLUE
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained...