Rust ONNX Runtime ML Frameworks

Language bindings and tooling for deploying ONNX models via ONNX Runtime in Rust. Includes inference engines, CLI analysis tools, and runtime wrappers. Does NOT include general ML libraries, tensor frameworks, or bindings to other inference backends (TVM, oneDNN, RKNN).

There are 53 rust onnx runtime frameworks tracked. 1 score above 70 (verified tier). The highest-rated is tracel-ai/burn at 76/100 with 14,588 stars and 75,546 monthly downloads. 3 of the top 10 are actively maintained.

Get all 53 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=rust-onnx-runtime&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	tracel-ai/burn Burn is a next generation tensor library and Deep Learning Framework that...	76	Verified	14,588	Rust
2	sonos/tract Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference	67	Established	2,818	Rust
3	pykeio/ort Fast ML inference & training for ONNX models in Rust	63	Established	2,068	Rust
4	elixir-nx/ortex ONNX Runtime bindings for Elixir	51	Established	198	Elixir
5	robertknight/rten ONNX neural network inference engine	50	Established	294	Rust
6	mosure/burn_dragon burn inference and training of baby dragon hatchling 🔥🐉	46	Emerging	12	Rust
7	tensorflow/rust Rust language bindings for TensorFlow	45	Emerging	5,471	Rust
8	matteocarnelos/microflow-rs A robust and efficient TinyML inference engine.	43	Emerging	171	Rust
9	CogitatorTech/infera A DuckDB extension for in-database inference	42	Emerging	128	Rust
10	tpoisonooo/rust-ncnn ncnn Rust API.	41	Emerging	49	Rust
11	ehsanmok/dlpackrs DLPack safe Rust binding	35	Emerging	15	Rust
12	edgeimpulse/edge-impulse-ffi-rs This project lets you run Edge Impulse machine learning models from Rust...	35	Emerging	2	C++
13	vertexclique/orkhon Orkhon: ML Inference Framework and Server Runtime	34	Emerging	151	Rust
14	epwalsh/batched-fn 🦀 Rust server plugin for deploying deep learning models with batched prediction	34	Emerging	22	Rust
15	HaoboGu/ors onnxruntime bindings for rust	34	Emerging	10	Rust
16	will-maclean/sb3-burn Implementation of stable-baselines3 in rust with burn	33	Emerging	20	Rust
17	FL33TW00D/steelix Your one stop CLI for ONNX model analysis.	32	Emerging	47	Rust
18	ehsanmok/tvm-rust (MERGED) Rust bindings for TVM runtime	32	Emerging	28	Rust
19	nhynes/onnx-rs ONNX for Rust	32	Emerging	18	Rust
20	doramatadora/edgeml Machine learning (ML) inference on Fastly's Compute@Edge	29	Experimental	16	Rust
21	boundarybitlabs/rknpu2-rs Rust bindings for the Rockchip RKNN Runtime API (librknnrt.so), used to...	29	Experimental	8	Rust
22	LdDl/tensorrt-infer Rust wrapper for NVIDIA TensorRT inference.	28	Experimental	1	Rust
23	xclud/rust_insightface Crate to work with Insightface's Face Detection and Face Swap models.	28	Experimental	10	Rust
24	epwalsh/rust-dl-webserver 🦀 Example of serving deep learning models in Rust with batched prediction	27	Experimental	34	Rust
25	kingwingfly/burnxp This component burnxp is for cloning one's Aesthetics Preferences, also...	27	Experimental	1	Rust
26	SongQiPing/KuiperInfer_rs 使用 Rust 语言重新实现 https://github.com/zjhellofss/KuiperInfer 和...	23	Experimental	16	Rust
27	lucidfrontier45/silva Tiny inference engine for tree ensemble models in Rust	22	Experimental	1	Rust
28	NTT123/ror Rust Onnx Runtime - a rust binding to onnx runtime	22	Experimental	2	Rust
29	qora-protocol/QORA-LLM-4B Pure Rust multimodal inference engine AI. No Python, no CUDA, no external ML...	21	Experimental	—	Rust
30	James-Wirth/pocket-inference Tiny Rust library for running Keras Sequential models	21	Experimental	—	Rust
31	ShankarKakumani/inference Zero-setup ML inference for Flutter using Rust engines (Candle, Linfa)	21	Experimental	6	Dart
32	jkawamoto/onednn-src Source of oneAPI Deep Neural Network Library (oneDNN)	21	Experimental	—	Rust
33	kykosic/actix-tensorflow-example An example of using TensorFlow rust bindings to serve trained machine...	21	Experimental	49	Rust
34	phenylshima/segmentation-models-burn Rust library for image segmentation using Burn.	21	Experimental	10	Rust
35	milenkovicm/torchfusion Torchfusion is a very opinionated torch inference on datafusion.	20	Experimental	5	Rust
36	kornia/kornia-infernum 👺 Rust Inference engine for Visual Language Models	19	Experimental	2	Rust
37	drbh/nnli 🔭 interactively explore `onnx` networks in your CLI.	19	Experimental	26	Rust
38	weiji14/climsimburn A machine learning model implemented in Rust 🦀 + Burn 🔥 for the LEAP -...	17	Experimental	1	Rust
39	claudiotancredi/RustONNX "Programmazione di sistema" project @ Politecnico di Torino, a.y. 2022/2023.	17	Experimental	1	Rust
40	martinabeleda/proton ⚡️ Blazingly fast machine learning predictions. Supports REST and gRPC	17	Experimental	1	Rust
41	matthewhaynesonline/provence-rs Rust inference implementation (with Candle) of the Provence Reranker model.	17	Experimental	—	Rust
42	edg-l/homura Rust ML inference framework built on MLIR	16	Experimental	2	Rust
43	Musbell/dl_pytorch_rust_challenge Exploring Deep Learning: Translating PyTorch to Rust using Burn	15	Experimental	9	Rust
44	Pects1949/Rust-ML-Inference-Engine A high-performance machine learning inference engine built with Rust for...	14	Experimental	—	Rust
45	kykosic/actix-pytorch-example An example of using Torch rust bindings to serve trained machine learning...	14	Experimental	17	Python
46	domenicocinque/burn-live-inference Axum + Burn model serving API	13	Experimental	—	Rust
47	milenkovicm/lightfusion LightGBM Inference on Datafusion	13	Experimental	2	Rust
48	unbgio/core-sdk Rust-first, local-only SDK workspace for background removal across CLI,...	13	Experimental	—	Rust
49	boydjohnson/onednnl-rs high-level Rust bindings to the oneDNN C api	13	Experimental	—	Rust
50	boydjohnson/onednnl-sys low-level Rust bindings to the oneDNN C API	13	Experimental	—	Rust
51	d6y/oner_induction An implementation of the 1R rule learner in Rust	11	Experimental	—	Rust
52	d6y/oner 1R application	11	Experimental	—	Rust
53	d6y/oner_quantize Qualization library based on 1R	11	Experimental	—	Rust

Comparisons in this category

burn and sb3-burn (76 vs 33) ort and rten (63 vs 50) ort and onnx-rs (63 vs 32) ort and ors (63 vs 34) rten and onnx-rs (50 vs 32) rten and ors (50 vs 34) ortex and ors (51 vs 34) ors and onnx-rs (34 vs 32)