Rust LLM Orchestration LLM Tools

Rust frameworks and SDKs for building, orchestrating, and coordinating LLM applications through modular architectures, DAGs, and workflow systems. Does NOT include general Rust LLM clients, language-specific integrations, or non-Rust orchestration platforms.

There are 57 rust llm orchestration tools tracked. 4 score above 50 (established tier). The highest-rated is 0xPlaygrounds/rig at 66/100 with 6,469 stars. 1 of the top 10 are actively maintained.

Get all 57 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=rust-llm-orchestration&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	0xPlaygrounds/rig ⚙️🦀 Build modular and scalable LLM Applications in Rust	66	Established	6,469	Rust
2	Abraxas-365/langchain-rust 🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust	58	Established	1,252	Rust
3	moly-ai/moly-ai Moly AI: A local + cloud AI LLM multi-platform GUI app in pure Rust	55	Established	404	Rust
4	ivangabriele/mistralai-client-rs Rust client for Mistral AI API.	52	Established	40	Rust
5	edgee-ai/rust-sdk The official Rust library for the Edgee AI Gateway	48	Emerging	80	Rust
6	hoangvvo/llm-sdk Unified API for LLM providers and simple agent library in JS, Rust, and Go	44	Emerging	15	Rust
7	InftyAI/AMRS 🧬 The adaptive model routing system for exploration and exploitation.	42	Emerging	22	Rust
8	avivsinai/litellm-rust Minimal Rust SDK port of LiteLLM – unified async client for OpenAI,...	41	Emerging	3	Rust
9	llm-edge/hal-9100 Edge full-stack LLM platform. Written in Rust	40	Emerging	384	Rust
10	omnidotdev/synapse 🧠 Orchestrated intelligence	39	Emerging	3	Rust
11	slb350/open-agent-sdk-rust Rust SDK for building AI agents with local OpenAI-compatible servers...	39	Emerging	13	Rust
12	kornia/bubbaloop_old 🦄 Serving Platform for Spatial AI and Robotics.	38	Emerging	23	Rust
13	minskylab/myself Myself is a Rust library for building conversational agents powered by LLM...	36	Emerging	7	Rust
14	guywaldman/orch Rust framework for LLM orchestration	35	Emerging	203	Rust
15	genai-rs/langfuse-client-base Auto-generated Rust client for Langfuse API from OpenAPI specification	33	Emerging	1	Rust
16	yottayoshida/llm-key-ring Secure CLI for managing LLM API keys via macOS Keychain. No more plaintext...	32	Emerging	14	Rust
17	evisdrenova/helix A new version control system built from the ground up that is 10-100x faster...	32	Emerging	24	Rust
18	guitaripod/Weavex Autonomous research agent powered by local LLMs	31	Emerging	8	Rust
19	cool-japan/oxify OxiFY is a graph-based LLM workflow orchestration platform built in Rust,...	29	Experimental	5	Rust
20	veecore/google-ai-rs Type-safe Rust client for Google's Generative AI APIs	28	Experimental	10	Rust
21	christianmeurer/Lula LangGraph orchestration scaffold (Python) + restricted tool runner (Rust)...	28	Experimental	6	Python
22	ctokx/tokmap Asynchronous network scanner in Rust. Uses nmap signature databases for...	25	Experimental	6	Rust
23	ducks/lok Local orchestration layer for coordinating multiple LLM backends through a...	25	Experimental	5	Rust
24	Siddhesh2377/ForgeAi ForgeAI : Your local model workshop, Load. Inspect. Merge. Ship.	24	Experimental	4	Rust
25	skorotkiewicz/conduit A decentralized peer-to-peer network for sharing and accessing Large...	24	Experimental	4	Rust
26	caioaao/onetool Sandboxed Lua runtime for LLM tool use.	23	Experimental	2	Rust
27	ramo-dev/tokwatch TokWatch monitors token usage across Claude Code, OpenCode, Ollama, Cursor,...	23	Experimental	1	TypeScript
28	jinyitao123/Weave Loom 的平台层 \| Agent platform built on Loom kernel — HTTP API, SSE streaming,...	22	Experimental	—	Go
29	merknu/folkering-os AI-native bare-metal OS in Rust — on-device LLM (Qwen3), WASM JIT code gen...	22	Experimental	—	Rust
30	LakshmiSravyaVedantham/llmux A lightweight Rust binary that sits between your code and every LLM API —...	22	Experimental	1	Rust
31	dravr-ai/dravr-embacle Rust library wrapping 12 AI CLI tools as pluggable LLM providers — with...	22	Experimental	1	Rust
32	hgahub/duumbi AI-first semantic graph compiler - programs as JSON-LD graphs, compiled to...	21	Experimental	—	Rust
33	overmindai/asimov Asimov helps you build high performance LLM apps, written in Rust 🦀	21	Experimental	11	Rust
34	wmahfoudh/crabai Minimal multi-provider LLM CLI. Single static binary, no runtime...	21	Experimental	—	Rust
35	axar-ai/prefrontal Blazing fast text classifier for real-time agent routing, built in Rust	21	Experimental	8	Rust
36	yail259/Hoist A safe, functional DSL for LLM orchestration — enforces resource limits,...	21	Experimental	—	Rust
37	hashdjdhhd/RustAPI ⚙️ Build powerful APIs with Rust for a modern development experience, ready...	21	Experimental	—	Rust
38	DamianWnorowski/llm-load-balancer Multi-provider LLM load balancer with cost tracking	21	Experimental	—	Rust
39	AivyxDev/aivyx-core Shared foundation crates for the Aivyx ecosystem	21	Experimental	—	Rust
40	wwk5q8z6kk-bit/Helix Dual-layer AI platform: Rust core + Python AI orchestration (LLM routing,...	21	Experimental	—	Rust
41	KitsuneX07/kotoba Unified Rust framework for orchestrating multi-vendor LLM workloads with...	21	Experimental	2	Rust
42	flyingrobots/llmrmgcore Rust LLM-driven deterministic graph core (v0 prototype)	20	Experimental	1	Rust
43	Alpine-Computing-Research/chinarxiv-rs Rust SDK for the ChinaRxiv public API	20	Experimental	1	Rust
44	TalhaBruh/Langchain-for-Rust This is the Rust language implementation of LangChain, The easiest way to...	19	Experimental	4	Rust
45	rming/dify-sdk-rs The Dify Client is a Rust library for interacting with the Dify service.	17	Experimental	1	Rust
46	kriptonian1/ai-rs Helps you ship AI powered application fast using rust	17	Experimental	—	Rust
47	DeepSheild-AI/Text-Chunker “LangChain TextSplitters — but as a fast, inspectable Rust CLI.”	17	Experimental	—	Rust
48	kulharir7/klaw Klaw - AI Gateway built in Rust. 6 crates, 33 providers, 22 channels, agent...	14	Experimental	1	Rust
49	AsherJingkongChen/poopoo 💩 A moonoorepoo pooject foo fun 💩	14	Experimental	1	Rust
50	ampactor-labs/forge CLI tool for multi-provider LLM conversations with tool use	14	Experimental	—	Rust
51	Qually5/vision-edge-rs Real-time computer vision processing optimized for edge devices.	14	Experimental	—	Rust
52	ducks/llm-mux Multiplexer for LLMs - route prompts to multiple backends and orchestrate...	13	Experimental	—	Rust
53	0xvasanth/rustchain A Rust implementation of the LangChain ecosystem — rustchain-core,...	13	Experimental	—	Rust
54	sobelio/llm-chain-template Jumpstart your llm-chain projects with the llm-chain-template repository!...	12	Experimental	6	Rust
55	XLauncher-Dev/toolkit A dual-language package (Go/Rust) for building and managing LLM function...	11	Experimental	—	Go
56	Grsaiago/oxide_langchain A Rust study implementation of langchain	11	Experimental	1	Rust
57	askgloom/core Gloom is a conversation engine built in C++ and Rust that emphasizes...	11	Experimental	—	Python