LLM Request Routing LLM Tools

Tools for intelligently routing, load-balancing, and directing LLM API requests across multiple providers, models, and inference endpoints. Does NOT include general API gateways, provider SDKs, or agent orchestration frameworks.

There are 63 llm request routing tools tracked. The highest-rated is unifyroute/unifyroute at 41/100 with 8 stars.

Get all 63 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=llm-request-routing&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	unifyroute/unifyroute Stop being locked into one LLM provider. UnifyRoute is a self-hosted gateway...	41	Emerging	8	Python
2	neuraxes/neurouter A powerful router that provides a unified interface for all upstream LLMs	36	Emerging	2	Go
3	deeflect/smart-spawn Intelligent model routing for AI agents. Auto-selects the right LLM per task...	36	Emerging	6	TypeScript
4	r9s-ai/open-next-router A lightweight, DSL-driven LLM gateway for routing, patching provider quirks,...	33	Emerging	13	Go
5	CarloLepelaars/irouter Access 100s of LLMs with minimal lines of code	33	Emerging	25	Jupyter Notebook
6	peva3/SmarterRouter SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama,...	33	Emerging	63	Python
7	abhi1693/open-llm-router Open-LLM Router is an OpenAI-compatible API gateway that intelligently...	28	Experimental	6	Python
8	emingenc/llm_adaptive_router llm_adaptive_router: Given the following query and candidate models, selects...	26	Experimental	6	Python
9	smarter-sh/smarter Smarter is an extensible AI resource management system	25	Experimental	3	JavaScript
10	zkywsg/ModelConfig Config-driven model routing for multi-provider AI apps.	24	Experimental	2	TypeScript
11	XtraVisionsAI/one-router Unified LLM API router — route OpenAI & Anthropic protocols to Bedrock,...	24	Experimental	2	Rust
12	mstfknn/llm-router Minimal LLM routing proxy. Zero dependencies, single binary.	23	Experimental	1	Go
13	dineshloki2612/barra 🚀 Build REST APIs easily with Barra, a Go toolkit that uses the standard...	23	Experimental	1	—
14	pranabjyotinath1999/llm-switchboard Route prompts to local large language models instantly to cut costs and...	23	Experimental	1	TypeScript
15	gh1002-ow1/llm-foundation Capability-based LLM routing for application teams, with free/paid tracks,...	23	Experimental	1	JavaScript
16	loral-labs/magic-carpet Magic Carpet is an open-source LLM router framework. With Magic Carpet,...	22	Experimental	1	Python
17	BlackRoad-AI/blackroad-ai-api-gateway Unified API gateway for all BlackRoad AI models with [MEMORY] integration	22	Experimental	—	JavaScript
18	plagness/LLM-MCP LLM routing core + workers + MCP bridge with persistent queue and Telegram telemetry.	22	Experimental	—	Go
19	BlackRoad-OS/models-blackroad-io models ulackroad io — Part of the BlackRoad OS ecosystem. Sovereign...	22	Experimental	—	HTML
20	BlackRoad-AI/models.blackroad.io models.ulackroad.io — Part of the BlackRoad OS ecosystem. Sovereign...	22	Experimental	—	HTML
21	BlackRoad-Security/security-model.blackroad.io security model.ulackroad.io — Part of the BlackRoad OS ecosystem. Sovereign...	22	Experimental	—	HTML
22	BlackRoad-AI/inference-blackroadio ARCHIVED: See BlackRoad-OS/sites for consolidated domain sites	22	Experimental	—	HTML
23	BlackRoad-OS/blackroad-os-vllm ulackroad os vllm — Part of the BlackRoad OS ecosystem. Sovereign computing,...	22	Experimental	—	HTML
24	BlackRoad-AI/vllm-deployment vllm deployment — Part of the BlackRoad OS ecosystem. Sovereign computing,...	22	Experimental	—	—
25	BlackRoad-AI/lucidia-ai-models-enhanced 🖤 Enhanced Lucidia AI models with BlackRoad optimizations	22	Experimental	—	HTML
26	BlackRoad-OS/blackroad-localai BlackRoad-enhanced LocalAI for local inference	22	Experimental	—	HTML
27	BlackRoad-OS-Inc/blackroad-chat BlackRoad AI Chat — Ollama-powered chat interface	22	Experimental	—	HTML
28	BlackRoad-OS/blackroad-vllm BlackRoad vLLM for LLM serving	22	Experimental	—	HTML
29	BlackRoad-AI/lucidia-ai-models 🧠 Lucidia AI Models Hub - Universal AI model memory and continuity layer...	22	Experimental	—	HTML
30	BlackRoad-AI/blackroad-ai-deepseek DeepSeek-V3 AI model deployment for BlackRoad infrastructure (MIT + Custom License)	22	Experimental	—	—
31	kidda229/polyroute 🚦Route LLM requests across OpenAI and Anthropic with automatic fallback,...	22	Experimental	—	Python
32	yashveerlabs/local-llm-router Auto-detects locally running LLMs and exposes a unified OpenAI-compatible API	22	Experimental	—	TypeScript
33	slb350/octoroute Smart HTTP router for local LLMs (Ollama, LM Studio, llama.cpp). Rule-based...	21	Experimental	6	Rust
34	ashwathnakate/adaptive_llm_inference_router An intelligent LLM inference gateway that dynamically routes user queries to...	20	Experimental	1	Python
35	wuleiyuan/smart-model-selector 🧠智能模型调度系统 - 基于任务类型自动选择最优 AI 模型，支持多 Provider 负载均衡、故障自动转移、成本优化	20	Experimental	1	Python
36	ZSeven-W/local-llm-router Local AI routing gateway with cost tracking. Proxy...	20	Experimental	1	JavaScript
37	chigwell/routerflu A new package is designed to streamline the interaction with large language...	19	Experimental	1	Python
38	l3ocifer/openferris OpenRouter for local compute. One API to route inference, storage, memory,...	19	Experimental	—	Rust
39	tumf/kani LLM smart router — classifies prompts by complexity and routes to the...	17	Experimental	4	Python
40	nep-0/llm-router A flexible and efficient OpenAI-compatible API router for large language...	15	Experimental	—	Go
41	mohsen-ahmed-pm/python-ai-model-router A lightweight Python router for calling multiple AI providers through a...	15	Experimental	1	Jupyter Notebook
42	marcossangomes/SmartLLM-Router 🔍 Optimize LLM requests by routing them to the best models, while leveraging...	14	Experimental	—	Jupyter Notebook
43	tatsuki817/llm-router Manage concurrent LLM requests with priority queues, multi-model routing,...	14	Experimental	—	HTML
44	rishiraj5219/rest-gateway-1771917362-4 Manage API requests with authentication and rate limiting using this RESTful...	14	Experimental	—	HTML
45	NABILA2308/routerflu 🚀 Streamline LLM interactions by converting natural inputs into structured,...	14	Experimental	—	Python
46	kellybossman/rest-gateway-1771916158-6 Provide secure RESTful API access with built-in authentication and rate...	14	Experimental	—	—
47	illogical/LMApi LMApi is an intelligent request router and load balancer for Ollama servers.	14	Experimental	—	TypeScript
48	rach390/rest-gateway-1771929895-4 Provide a fast, easy-to-use REST API gateway with high performance and zero...	14	Experimental	—	Go
49	faresbenbelkacem/OpenRouterBench 🚀 Benchmark LLM routing with OpenRouterBench, featuring 25+ datasets and...	14	Experimental	—	Python
50	Fhaz5000/llm-router Route prompts efficiently to appropriate modes for large language models...	14	Experimental	—	HTML
51	EveLweiss/opt-routing-framework A conceptual framework for interpreting and structuring routing in...	14	Experimental	—	—
52	Aditya0963/modelrelay Route AI coding requests locally to the best free OpenAI-compatible models...	14	Experimental	—	—
53	Meghasukkayapally/rest-gateway-1771916148-2 Provide a RESTful API gateway that manages authentication and enforces rate...	14	Experimental	—	—
54	Firmancaaa/rest-gateway-1771916753-3 Provide a RESTful API gateway that manages authentication and enforces rate...	14	Experimental	—	—
55	JFPastor09/rest-gateway-1771916756-4 Provide secure RESTful API access with authentication and rate limiting to...	14	Experimental	—	—
56	HitmanCR/rest-gateway-1771917206-3 Provide a RESTful API gateway that manages authentication and controls...	14	Experimental	—	—
57	danseb93/filter-free-models-for-open-router Automatically discover, filter, and test free AI models available on...	13	Experimental	2	JavaScript
58	neutrome-labs/open-ai-router Caddy-module implementing multi-provider AI routing	13	Experimental	2	Go
59	Chainsmoker23/llm-flow-router Tiny Express-like multiplexer for routing AI prompts to multiple providers...	12	Experimental	1	JavaScript
60	juyterman1000/smartllm-router This is the LLM money saver library for the developers, testers, product...	12	Experimental	1	Python
61	RichardHam-co-uk/LocalLLM-Router-Project Advanced local LLM routing system built with Node.js to offload tasks to...	11	Experimental	—	JavaScript
62	michael-bmstu/llm-router A Router component based on LLM that will redirect the user's request to...	11	Experimental	—	Python
63	nkenchor/odyn-go-router High-performance Go (Gin) router for OpenAI-compatible llama.cpp inference,...	11	Experimental	—	Go