guywaldman/orch
Rust framework for LLM orchestration
Supports streaming responses, structured output generation with compile-time schema validation, and embedding generation across multiple LM backends. Built on async/await with pluggable provider integrations (currently Ollama), enabling both free-form text and constrained JSON responses via macro-driven variant schemas. Designed for agent-building workflows with preamble customization and type-safe response handling.
203 stars and 27 monthly downloads. No commits in the last 6 months.
Stars
203
Forks
4
Language
Rust
License
MIT
Category
Last pushed
Jul 27, 2024
Monthly downloads
27
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/guywaldman/orch"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
0xPlaygrounds/rig
⚙️🦀 Build modular and scalable LLM Applications in Rust
Abraxas-365/langchain-rust
🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust
moly-ai/moly-ai
Moly AI: A local + cloud AI LLM multi-platform GUI app in pure Rust
ivangabriele/mistralai-client-rs
Rust client for Mistral AI API.
edgee-ai/rust-sdk
The official Rust library for the Edgee AI Gateway