ssbuild/aigc_serving
aigc_serving lightweight and efficient Language service model reasoning
This project helps developers serve large language models efficiently, allowing them to integrate powerful AI text generation and understanding capabilities into their applications. It takes various pre-trained language models as input and provides responses for tasks like chat, text completion, and generating embeddings, acting as a backend service. Software developers building AI-powered applications would use this.
No commits in the last 6 months.
Use this if you are a developer looking to deploy and manage a diverse range of large language models for your applications, offering features like chat, text generation, and embedding services.
Not ideal if you are an end-user without programming experience seeking a ready-to-use application; this is a backend service for developers.
Stars
24
Forks
2
Language
Python
License
Apache-2.0
Category
Last pushed
Jun 12, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/ssbuild/aigc_serving"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
cloudwego/eino
The ultimate LLM/AI application development framework in Go.
xyproto/algernon
Small self-contained pure-Go web server with Lua, Teal, Markdown, Ollama, HTTP/2, QUIC, Redis,...
instill-ai/instill-core
🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline...
gocnn/candy
Minimalist ML framework for Go.
Shuffle/Singul
Singul: Connect to your favorite services with a Singul line of code.