Llm Orchestration Platforms LLM Tools

There are 20 llm orchestration platforms tools tracked. 4 score above 50 (established tier). The highest-rated is adysec/OllamaR at 57/100 with 185 stars.

Get all 20 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=llm-orchestration-platforms&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	adysec/OllamaR Ollama负载均衡服务器 \| 一款高性能、易配置的开源负载均衡服务器，优化Ollama负载。它能够帮助您提高应用程序的可用性和响应速度，同时确保系统资源的有效利用。	57	Established	185	—
2	majiayu000/litellm-rs A high-performance AI Gateway written in Rust — call 100+ LLM APIs using...	55	Established	33	Rust
3	intelligentnode/IntelliNode Access the latest AI models like ChatGPT, LLaMA, Deepseek, Diffusion,...	53	Established	272	JavaScript
4	wpydcr/LLM-Kit 🚀WebUI integrated platform for latest LLMs \| 各大语言模型的全流程工具 WebUI...	50	Established	550	Python
5	henomis/lingoose 🪿 LinGoose is a Go framework for building awesome AI/LLM applications.	44	Emerging	831	Go
6	llmapi-io/llmapi-server Self-host llmapi server, make it really easy for accessing LLMs ! :rocket:	32	Emerging	37	Python
7	eon01/OpenAIGPTForPythonDevelopersFiles This repository contains the code and other resources used in OpenAI GPT for...	31	Emerging	12	—
8	QwertyMcQwertz/monkeys-with-typewriters The complete AI platform on a $3 microcontroller. Sub-millisecond inference....	30	Emerging	46	C++
9	unkn0wncode/openai A simple Go client for OpenAI’s API that supports most of the features you...	27	Experimental	2	Go
10	hekmon/go-honcho Go bindings for Honcho - Persistent memory layer for AI applications....	25	Experimental	1	Go
11	fabriciosantos273738/llm-chat Manage multi-turn conversations efficiently with a lightweight C++ library...	22	Experimental	—	C++
12	Tberke0/go-llm 🤖 Simulate AI with go-llm, your unified Go SDK for various Large Language...	21	Experimental	—	Go
13	codingisloading/monkeys-with-typewriters Deliver AI capabilities with low latency and minimal power using a $3...	21	Experimental	—	C++
14	GSejas/gacetachat Daily AI summaries of Costa Rica's official gazette. Simple. Fast. Open source.	21	Experimental	—	HTML
15	defrecord/llm-lab LLM Tools Lab: Testing environment for exploring LLM CLI tools (llm (0.21),...	19	Experimental	1	Shell
16	mshobari/local_ollama_project 🤖 Build a local AI assistant that categorizes user input with structured...	13	Experimental	—	—
17	redoh/openai-toolkit 🔧 OpenAI API toolkit — GPT-4, DALL-E, Whisper, embeddings with streaming and...	13	Experimental	—	—
18	mirzamdhammad6266/llm-microservice-hub Production-grade LLM microservice built with FastAPI and AsyncIO, including...	12	Experimental	1	Python
19	winklermw-mz/AIProxy This project is a Flask-based API proxy that provides an OpenAI-compatible...	12	Experimental	1	Python
20	salim4n/rust-chatbot-service Rust Microservice for my landing page at url https://ignitionai.fr/	11	Experimental	3	Rust