Llm Orchestration Platforms Transformer Models

There are 10 llm orchestration platforms models tracked. 1 score above 50 (established tier). The highest-rated is mgonzs13/llama_ros at 56/100 with 245 stars.

Get all 10 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=llm-orchestration-platforms&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	mgonzs13/llama_ros llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2	56	Established	245	C++
2	muxi-ai/onellm Unified interface for interacting with various LLMs hundreds of models,...	49	Emerging	44	Python
3	Atome-FE/llama-node Believe in AI democratization. llama for nodejs backed by llama-rs,...	43	Emerging	867	Rust
4	docusealco/rllama Ruby FFI bindings for llama.cpp to run open-source LLMs such as GPT-OSS,...	26	Experimental	87	Ruby
5	Rin313/StegLLM 离线的LLM文本隐写程序。Offline LLM text steganography program.	24	Experimental	21	Astro
6	XrecentX/vllm-skills 🚀 Deploy and manage vLLM with ready-made skills for modular automation,...	21	Experimental	—	Shell
7	code-vygr/local-llm-ocr-ollama 🖼️ Extract text from images locally using Ollama's LLMs—100% free, offline,...	19	Experimental	2	Python
8	GhostGuyyt/llm-cpp Provide lightweight, zero-dependency C++17 single-header libraries to...	14	Experimental	—	JavaScript
9	jtgsystems/Ollama-Menu Interactive Windows batch menu for 160+ Ollama AI models. Browse, update,...	13	Experimental	—	Batchfile
10	Payton2cool4/LLMs-local 🚀 Explore tools and resources to run large language models locally,...	13	Experimental	—	—