llm-edge/hal-9100
Edge full-stack LLM platform. Written in Rust
Provides autonomous code execution in sandboxed environments, knowledge retrieval, function calling, and API actions through an OpenAI-compatible SDK. Designed for edge deployment with open-source LLMs (Ollama, Mistral, vLLM), eliminating internet dependency and enabling private data handling on resource-constrained devices like Raspberry Pi. Prioritizes deterministic behavior and minimal hard-coded prompts, allowing developers to deploy production AI assistants with custom models and infrastructure.
384 stars. No commits in the last 6 months.
Stars
384
Forks
32
Language
Rust
License
MIT
Category
Last pushed
May 25, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/llm-edge/hal-9100"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
0xPlaygrounds/rig
⚙️🦀 Build modular and scalable LLM Applications in Rust
Abraxas-365/langchain-rust
🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust
moly-ai/moly-ai
Moly AI: A local + cloud AI LLM multi-platform GUI app in pure Rust
ivangabriele/mistralai-client-rs
Rust client for Mistral AI API.
edgee-ai/rust-sdk
The official Rust library for the Edgee AI Gateway