Rust LLM Orchestration LLM Tools

Rust frameworks and SDKs for building, orchestrating, and coordinating LLM applications through modular architectures, DAGs, and workflow systems. Does NOT include general Rust LLM clients, language-specific integrations, or non-Rust orchestration platforms.

There are 61 rust llm orchestration tools tracked. 3 score above 50 (established tier). The highest-rated is 0xPlaygrounds/rig at 69/100 with 6,469 stars. 1 of the top 10 are actively maintained.

Get all 61 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=rust-llm-orchestration&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	0xPlaygrounds/rig ⚙️🦀 Build modular and scalable LLM Applications in Rust	69	Established	6,469	Rust
2	Abraxas-365/langchain-rust 🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust	54	Established	1,252	Rust
3	moly-ai/moly-ai Moly AI: A local + cloud AI LLM multi-platform GUI app in pure Rust	51	Established	404	Rust
4	ivangabriele/mistralai-client-rs Rust client for Mistral AI API.	45	Emerging	40	Rust
5	edgee-ai/rust-sdk The official Rust library for the Edgee AI Gateway	44	Emerging	80	Rust
6	avivsinai/litellm-rust Minimal Rust SDK port of LiteLLM – unified async client for OpenAI,...	39	Emerging	3	Rust
7	omnidotdev/synapse 🧠 Orchestrated intelligence	37	Emerging	3	Rust
8	hoangvvo/llm-sdk Unified API for LLM providers and simple agent library in JS, Rust, and Go	37	Emerging	15	Rust
9	InftyAI/AMRS 🧬 The adaptive model routing system for exploration and exploitation.	35	Emerging	22	Rust
10	slb350/open-agent-sdk-rust Rust SDK for building AI agents with local OpenAI-compatible servers...	35	Emerging	13	Rust
11	yottayoshida/llm-key-ring Secure CLI for managing LLM API keys via macOS Keychain. No more plaintext...	33	Emerging	14	Rust
12	llm-edge/hal-9100 Edge full-stack LLM platform. Written in Rust	33	Emerging	384	Rust
13	kornia/bubbaloop_old 🦄 Serving Platform for Spatial AI and Robotics.	31	Emerging	23	Rust
14	evisdrenova/helix A new version control system built from the ground up that is 10-100x faster...	30	Emerging	24	Rust
15	minskylab/myself Myself is a Rust library for building conversational agents powered by LLM...	29	Experimental	7	Rust
16	guywaldman/orch Rust framework for LLM orchestration	28	Experimental	203	Rust
17	veecore/google-ai-rs Type-safe Rust client for Google's Generative AI APIs	26	Experimental	10	Rust
18	christianmeurer/Lula LangGraph orchestration scaffold (Python) + restricted tool runner (Rust)...	26	Experimental	6	Python
19	dabevlohn/rag-article-rs Extremely fast privacy first Deep Research with SearXNG and Ollama	26	Experimental	3	Rust
20	ctokx/tokmap Asynchronous network scanner in Rust. Uses nmap signature databases for...	26	Experimental	6	Rust
21	cool-japan/oxify OxiFY is a graph-based LLM workflow orchestration platform built in Rust,...	25	Experimental	5	Rust
22	guitaripod/Weavex Autonomous research agent powered by local LLMs	25	Experimental	8	Rust
23	Okosa2/ion-lang 🚀 Transpile Ion to C efficiently, leveraging move-only ownership and...	24	Experimental	2	Rust
24	LoveIiei/RustGraph Faster and smaller LangGraph in Rust	23	Experimental	1	Rust
25	ducks/lok Local orchestration layer for coordinating multiple LLM backends through a...	23	Experimental	5	Rust
26	jyjeanne/crabrace A high-performance, memory-safe HTTP-based AI provider database service...	23	Experimental	2	Rust
27	dravr-ai/dravr-embacle Rust library wrapping 12 AI CLI tools as pluggable LLM providers — with...	23	Experimental	1	Rust
28	genai-rs/langfuse-client-base Auto-generated Rust client for Langfuse API from OpenAPI specification	23	Experimental	1	Rust
29	LakshmiSravyaVedantham/llmux A lightweight Rust binary that sits between your code and every LLM API —...	23	Experimental	1	Rust
30	ramo-dev/tokwatch TokWatch monitors token usage across Claude Code, OpenCode, Ollama, Cursor,...	23	Experimental	1	TypeScript
31	Siddhesh2377/ForgeAi ForgeAI : Your local model workshop, Load. Inspect. Merge. Ship.	22	Experimental	4	Rust
32	skorotkiewicz/conduit A decentralized peer-to-peer network for sharing and accessing Large...	22	Experimental	4	Rust
33	jinyitao123/Weave Loom 的平台层 \| Agent platform built on Loom kernel — HTTP API, SSE streaming,...	22	Experimental	—	Go
34	merknu/folkering-os AI-native bare-metal OS in Rust — on-device LLM (Qwen3), WASM JIT code gen...	22	Experimental	—	Rust
35	AivyxDev/aivyx-core Shared foundation crates for the Aivyx ecosystem	22	Experimental	—	Rust
36	hashdjdhhd/RustAPI ⚙️ Build powerful APIs with Rust for a modern development experience, ready...	22	Experimental	—	Rust
37	wwk5q8z6kk-bit/Helix Dual-layer AI platform: Rust core + Python AI orchestration (LLM routing,...	22	Experimental	—	Rust
38	hgahub/duumbi AI-first semantic graph compiler - programs as JSON-LD graphs, compiled to...	22	Experimental	—	Rust
39	GrandpaEJ/Mini_LangChain High-performance LLM orchestration in Rust. Fast RAG, memory, and agents for...	21	Experimental	2	Rust
40	caioaao/onetool Sandboxed Lua runtime for LLM tool use.	21	Experimental	2	Rust
41	Alpine-Computing-Research/chinarxiv-rs Rust SDK for the ChinaRxiv public API	20	Experimental	1	Rust
42	DamianWnorowski/llm-load-balancer Multi-provider LLM load balancer with cost tracking	19	Experimental	—	Rust
43	wmahfoudh/crabai Minimal multi-provider LLM CLI. Single static binary, no runtime...	19	Experimental	—	Rust
44	yail259/Hoist A safe, functional DSL for LLM orchestration — enforces resource limits,...	19	Experimental	—	Rust
45	KitsuneX07/kotoba Unified Rust framework for orchestrating multi-vendor LLM workloads with...	17	Experimental	2	Rust
46	flyingrobots/llmrmgcore Rust LLM-driven deterministic graph core (v0 prototype)	16	Experimental	1	Rust
47	cam-barts/rs_document A opinionated Rust implementation of various common functions of LangChain's...	16	Experimental	1	Python
48	kriptonian1/ai-rs Helps you ship AI powered application fast using rust	15	Experimental	—	Rust
49	DeepSheild-AI/Text-Chunker “LangChain TextSplitters — but as a fast, inspectable Rust CLI.”	15	Experimental	—	Rust
50	axar-ai/prefrontal Blazing fast text classifier for real-time agent routing, built in Rust	14	Experimental	8	Rust
51	0xvasanth/cognis A Rust implementation of the LangChain ecosystem — rustchain-core,...	14	Experimental	—	Rust
52	ampactor-labs/forge CLI tool for multi-provider LLM conversations with tool use	14	Experimental	—	Rust
53	Wasisange/vision-edge-rust Real-time object detection and tracking optimized for edge devices using...	14	Experimental	—	Rust
54	Qually5/vision-edge-rs Real-time computer vision processing optimized for edge devices.	14	Experimental	—	Rust
55	overmindai/asimov Asimov helps you build high performance LLM apps, written in Rust 🦀	14	Experimental	11	Rust
56	0xvasanth/rustchain A Rust implementation of the LangChain ecosystem — rustchain-core,...	14	Experimental	—	Rust
57	TalhaBruh/Langchain-for-Rust This is the Rust language implementation of LangChain, The easiest way to...	12	Experimental	4	Rust
58	AsherJingkongChen/poopoo 💩 A moonoorepoo pooject foo fun 💩	12	Experimental	1	Rust
59	kulharir7/klaw Klaw - AI Gateway built in Rust. 6 crates, 33 providers, 22 channels, agent...	12	Experimental	1	Rust
60	ducks/llm-mux Multiplexer for LLMs - route prompts to multiple backends and orchestrate...	11	Experimental	—	Rust
61	rming/dify-sdk-rs The Dify Client is a Rust library for interacting with the Dify service.	10	Experimental	1	Rust