eren23/synapse
Modular LLM inference engine in Rust + Zig SIMD kernels. Runs on desktop (Metal GPU), browser (WASM), and ESP32. INT8/Q4 quantization, speculative decoding, multi-model support.
Stars
—
Forks
—
Language
Rust
License
—
Category
Last pushed
Mar 27, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/eren23/synapse"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
trymirai/uzu
A high-performance inference engine for AI models
lipish/llm-connector
LLM Connector - A unified interface for connecting to various Large Language Model providers
justrach/bhumi
⚡ Bhumi – The fastest AI inference client for Python, built with Rust for unmatched speed,...
rustformers/llm
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
keyvank/femtoGPT
Pure Rust implementation of a minimal Generative Pretrained Transformer