ashwathnakate/adaptive_llm_inference_router
An intelligent LLM inference gateway that dynamically routes user queries to optimal model tiers (Llama-3.1 8B/70B) based on real-time complexity, reasoning depth, and ambiguity analysis.
Stars
1
Forks
—
Language
Python
License
MIT
Category
Last pushed
Jan 17, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/ashwathnakate/adaptive_llm_inference_router"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
unifyroute/unifyroute
Stop being locked into one LLM provider. UnifyRoute is a self-hosted gateway that routes, fails...
deeflect/smart-spawn
Intelligent model routing for AI agents. Auto-selects the right LLM per task based on...
neuraxes/neurouter
A powerful router that provides a unified interface for all upstream LLMs
peva3/SmarterRouter
SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and...
CarloLepelaars/irouter
Access 100s of LLMs with minimal lines of code