Llm Orchestration Platforms RAG Tools

There are 4 llm orchestration platforms tools tracked. 1 score above 50 (established tier). The highest-rated is crmne/ruby_llm at 66/100 with 3,718 stars. 1 of the top 10 are actively maintained.

Get all 4 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=rag&subcategory=llm-orchestration-platforms&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Tool Score Tier
1 crmne/ruby_llm

One beautiful Ruby API for OpenAI, Anthropic, Gemini, Bedrock, Azure,...

66
Established
2 IngressTechnology/jimbomesh-holler-server

Open source AI inference server with Model Marketplace, Document RAG, and...

37
Emerging
3 AdarshTiwari3/ai-engineering-hub

LLMs, LangChain, RAG, agents, embeddings, system-level AI experiments

21
Experimental
4 polikyma/local-llm-project

Local-first AI assistant. Open source models, RAG, zero cloud dependency.

14
Experimental