Rust ONNX Runtime ML Frameworks

Language bindings and tooling for deploying ONNX models via ONNX Runtime in Rust. Includes inference engines, CLI analysis tools, and runtime wrappers. Does NOT include general ML libraries, tensor frameworks, or bindings to other inference backends (TVM, oneDNN, RKNN).

There are 61 rust onnx runtime frameworks tracked. 2 score above 70 (verified tier). The highest-rated is tracel-ai/burn at 79/100 with 14,588 stars and 72,188 monthly downloads. 3 of the top 10 are actively maintained.

Get all 61 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=rust-onnx-runtime&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Framework	Score	Tier	Stars	Language
1	tracel-ai/burn Burn is a next generation tensor library and Deep Learning Framework that...	79	Verified	14,588	Rust
2	sonos/tract Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference	70	Verified	2,818	Rust
3	pykeio/ort Fast ML inference & training for ONNX models in Rust	62	Established	2,068	Rust
4	robertknight/rten ONNX neural network inference engine	46	Emerging	294	Rust
5	tensorflow/rust Rust language bindings for TensorFlow	45	Emerging	5,471	Rust
6	elixir-nx/ortex ONNX Runtime bindings for Elixir	44	Emerging	198	Elixir
7	mosure/burn_dragon burn inference and training of baby dragon hatchling 🔥🐉	43	Emerging	12	Rust
8	CogitatorTech/infera A DuckDB extension for in-database inference	39	Emerging	128	Rust
9	matteocarnelos/microflow-rs A robust and efficient TinyML inference engine.	36	Emerging	171	Rust
10	tpoisonooo/rust-ncnn ncnn Rust API.	34	Emerging	49	Rust
11	edgeimpulse/edge-impulse-ffi-rs This project lets you run Edge Impulse machine learning models from Rust...	29	Experimental	2	C++
12	ehsanmok/dlpackrs DLPack safe Rust binding	28	Experimental	15	Rust
13	Atliac/wgc An ergonomic Rust wrapper for Windows.Graphics.Capture API	28	Experimental	5	Rust
14	epwalsh/batched-fn 🦀 Rust server plugin for deploying deep learning models with batched prediction	27	Experimental	22	Rust
15	vertexclique/orkhon Orkhon: ML Inference Framework and Server Runtime	27	Experimental	151	Rust
16	HaoboGu/ors onnxruntime bindings for rust	27	Experimental	10	Rust
17	LdDl/tensorrt-infer Rust wrapper for NVIDIA TensorRT inference.	27	Experimental	1	Rust
18	will-maclean/sb3-burn Implementation of stable-baselines3 in rust with burn	26	Experimental	20	Rust
19	FL33TW00D/steelix Your one stop CLI for ONNX model analysis.	25	Experimental	47	Rust
20	zlogic/matrix-eyes A Rust port of Apple Depth Pro which can output stereograms and 3D models	25	Experimental	4	Rust
21	nhynes/onnx-rs ONNX for Rust	25	Experimental	18	Rust
22	ehsanmok/tvm-rust (MERGED) Rust bindings for TVM runtime	25	Experimental	28	Rust
23	boundarybitlabs/rknpu2-rs Rust bindings for the Rockchip RKNN Runtime API (librknnrt.so), used to...	23	Experimental	8	Rust
24	Zeus01214/RealOne 🔍 Calculate and verify file checksums effortlessly with RealOne, a modern...	22	Experimental	—	Rust
25	doramatadora/edgeml Machine learning (ML) inference on Fastly's Compute@Edge	22	Experimental	16	Rust
26	James-Wirth/pocket-inference Tiny Rust library for running Keras Sequential models	22	Experimental	—	Rust
27	qora-protocol/QORA-LLM-4B Pure Rust multimodal inference engine AI. No Python, no CUDA, no external ML...	22	Experimental	—	Rust
28	deploifai/meteorite A fast and simple web server for machine learning models	21	Experimental	8	Rust
29	xclud/rust_insightface Crate to work with Insightface's Face Detection and Face Swap models.	21	Experimental	10	Rust
30	epwalsh/rust-dl-webserver 🦀 Example of serving deep learning models in Rust with batched prediction	20	Experimental	34	Rust
31	kingwingfly/burnxp This component burnxp is for cloning one's Aesthetics Preferences, also...	20	Experimental	1	Rust
32	mosure/burn_depth burn depth pro model inference🔥📐😎	20	Experimental	4	Rust
33	jkawamoto/onednn-src Source of oneAPI Deep Neural Network Library (oneDNN)	19	Experimental	—	Rust
34	PratikBarhate/hushar gRPC server for Machine Learning (ML) Model Inference in Rust.	18	Experimental	3	Rust
35	lucidfrontier45/silva Tiny inference engine for tree ensemble models in Rust	17	Experimental	1	Rust
36	SongQiPing/KuiperInfer_rs 使用 Rust 语言重新实现 https://github.com/zjhellofss/KuiperInfer 和...	16	Experimental	16	Rust
37	edg-l/homura Rust ML inference framework built on MLIR	16	Experimental	2	Rust
38	ShankarKakumani/inference Zero-setup ML inference for Flutter using Rust engines (Candle, Linfa)	15	Experimental	6	Dart
39	matthewhaynesonline/provence-rs Rust inference implementation (with Candle) of the Provence Reranker model.	15	Experimental	—	Rust
40	NTT123/ror Rust Onnx Runtime - a rust binding to onnx runtime	15	Experimental	2	Rust
41	Frexio/pegainfer Run efficient LLM inference using a Rust-based engine with custom CUDA...	14	Experimental	—	Rust
42	phenylshima/segmentation-models-burn Rust library for image segmentation using Burn.	14	Experimental	10	Rust
43	Pects1949/Rust-ML-Inference-Engine A high-performance machine learning inference engine built with Rust for...	14	Experimental	—	Rust
44	kayagokalp/handtrack-rs A library for prototyping hand detection and tracking (bounding box) for rust	14	Experimental	2	Rust
45	Poin1961/ml-model-server A high-performance, low-latency machine learning model serving framework...	14	Experimental	—	Rust
46	Kaden-Schutt/hipfire RDNA-native LLM inference engine in Rust. 59 tok/s Qwen3-8B on RX 5700 XT —...	14	Experimental	—	Rust
47	kykosic/actix-tensorflow-example An example of using TensorFlow rust bindings to serve trained machine...	14	Experimental	49	Rust
48	milenkovicm/torchfusion Torchfusion is a very opinionated torch inference on datafusion.	13	Experimental	5	Rust
49	szheng3/Rust-cli-pre-trained-models Rust cli that summarizes text with pre-trained models	13	Experimental	5	Rust
50	kornia/kornia-infernum 👺 Rust Inference engine for Visual Language Models	13	Experimental	2	Rust
51	drbh/nnli 🔭 interactively explore `onnx` networks in your CLI.	12	Experimental	26	Rust
52	ALinuxPerson/textsynth A (unofficial) Rust wrapper for the TextSynth API.	11	Experimental	1	Rust
53	unbgio/core-sdk Rust-first, local-only SDK workspace for background removal across CLI,...	11	Experimental	—	Rust
54	domenicocinque/burn-live-inference Axum + Burn model serving API	11	Experimental	—	Rust
55	milenkovicm/lightfusion LightGBM Inference on Datafusion	11	Experimental	2	Rust
56	218097123/word-doc-qa CPUT Academic Calendar Q&A System built with Rust and Burn 0.20.1,...	11	Experimental	—	Rust
57	boydjohnson/onednnl-rs high-level Rust bindings to the oneDNN C api	11	Experimental	—	Rust
58	boydjohnson/onednnl-sys low-level Rust bindings to the oneDNN C API	11	Experimental	—	Rust
59	martinabeleda/proton ⚡️ Blazingly fast machine learning predictions. Supports REST and gRPC	10	Experimental	1	Rust
60	weiji14/climsimburn A machine learning model implemented in Rust 🦀 + Burn 🔥 for the LEAP -...	10	Experimental	1	Rust
61	claudiotancredi/RustONNX "Programmazione di sistema" project @ Politecnico di Torino, a.y. 2022/2023.	10	Experimental	1	Rust

Comparisons in this category

burn and sb3-burn (79 vs 26) tract and rust (70 vs 45) tract and ort (70 vs 62) tract and rten (70 vs 46) tract and microflow-rs (70 vs 36) tract and ors (70 vs 27) tract and tensorrt-infer (70 vs 27) ort and rten (62 vs 46) ort and ors (62 vs 27) rten and ors (46 vs 27)