Rust Llm Infrastructure Transformer Models

There are 11 rust llm infrastructure models tracked. 2 score above 50 (established tier). The highest-rated is EricLBuehler/mistral.rs at 65/100 with 6,681 stars. 1 of the top 10 are actively maintained.

Get all 11 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=rust-llm-infrastructure&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	EricLBuehler/mistral.rs Fast, flexible LLM inference	65	Established	6,681	Rust
2	nerdai/llms-from-scratch-rs A comprehensive Rust translation of the code from Sebastian Raschka's Build...	56	Established	306	Rust
3	brontoguana/krasis Krasis is a Hybrid LLM runtime which focuses on efficient running of larger...	41	Emerging	52	Rust
4	ShelbyJenkins/llm_utils llm_utils: Basic LLM tools, best practices, and minimal abstraction.	35	Emerging	48	Rust
5	Mattbusel/llm-wasm LLM inference primitives for WebAssembly — cache, retry, routing, guards,...	25	Experimental	2	Rust
6	GoWtEm/llm-model-selector A high-performance Rust utility that analyzes your system hardware to...	24	Experimental	4	Rust
7	qora-protocol/QORA-LLM-3B Pure Rust inference engine for the SmolLM3-3B language model. No Python...	22	Experimental	1	Rust
8	Ranjitbarnala0/rai CPU-native LLM inference engine — hand-written SIMD kernels, 4-bit...	21	Experimental	—	Rust
9	magic003/llama2-rs Inference Llama 2 in Rust	13	Experimental	—	Rust
10	ltouati/tiny-llm A tiny llm writen using rust candle	13	Experimental	—	Rust
11	UE2020/DeclineFormer Efficiently translating Latin to English using a sequence-to-sequence...	10	Experimental	2	Rust