sangyuxiaowu/LLamaWorker
LLamaWorker is a HTTP API server developed based on the LLamaSharp project. It provides an OpenAI-compatible API, making it easy for developers to integrate Large Language Models (LLM) into their applications.
This project helps developers integrate large language models (LLMs) into their software applications. It takes various open-source LLMs and provides a standardized API for developers to easily connect their applications to these models, making it simple to add features like chat, text completion, and text embeddings. Developers creating applications that need AI capabilities would use this.
Use this if you are a developer looking for an easy way to add open-source large language model capabilities to your applications using a familiar API.
Not ideal if you are an end-user looking for a ready-to-use application, as this is a developer tool requiring technical setup.
Stars
80
Forks
11
Language
C#
License
Apache-2.0
Category
Last pushed
Mar 03, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/sangyuxiaowu/LLamaWorker"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
containers/ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from...
av/harbor
One command brings a complete pre-wired LLM stack with hundreds of services to explore.
RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
runpod-workers/worker-vllm
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
foldl/chatllm.cpp
Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)