slb350/octoroute

Smart HTTP router for local LLMs (Ollama, LM Studio, llama.cpp). Rule-based + LLM-powered routing, health checks, load balancing, Prometheus metrics. Rust-native, zero-overhead.

21
/ 100
Experimental
No Package No Dependents
Maintenance 6 / 25
Adoption 6 / 25
Maturity 9 / 25
Community 0 / 25

How are scores calculated?

Stars

6

Forks

—

Language

Rust

License

MIT

Category

llm-request-routing

Last pushed

Nov 27, 2025

Monthly downloads

5

Commits (30d)

0

GitHub
LLM Request Routing · 63 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/slb350/octoroute"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

unifyroute/unifyroute

Stop being locked into one LLM provider. UnifyRoute is a self-hosted gateway that routes, fails...

41

neuraxes/neurouter

A powerful router that provides a unified interface for all upstream LLMs

36

deeflect/smart-spawn

Intelligent model routing for AI agents. Auto-selects the right LLM per task based on...

36

peva3/SmarterRouter

SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and...

35

r9s-ai/open-next-router

A lightweight, DSL-driven LLM gateway for routing, patching provider quirks, and normalizing...

33

Explore LLM Tools

All categories Trending LLM Tool directory Insights