Rust Llm Infrastructure Transformer Models

There are 4 rust llm infrastructure models tracked. 2 score above 50 (established tier). The highest-rated is EricLBuehler/mistral.rs at 62/100 with 6,681 stars. 1 of the top 10 are actively maintained.

Get all 4 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=rust-llm-infrastructure&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	EricLBuehler/mistral.rs Fast, flexible LLM inference	62	Established	6,681	Rust
2	nerdai/llms-from-scratch-rs A comprehensive Rust translation of the code from Sebastian Raschka's Build...	52	Established	306	Rust
3	brontoguana/krasis Krasis is a Hybrid LLM runtime which focuses on efficient running of larger...	42	Emerging	52	Rust
4	ShelbyJenkins/llm_utils llm_utils: Basic LLM tools, best practices, and minimal abstraction.	28	Experimental	48	Rust