RouteWorks/RouterArena

RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.

50
/ 100
Established

The platform evaluates routers across five specialized metrics—accuracy, cost-efficiency, optimal selection rate, robustness, and latency—using a principled dataset spanning 9 domains with difficulty stratification. It provides automated end-to-end evaluation pipelines compatible with both open-source and commercial routers via standardized config files, with extensible support for custom router implementations and multiple LLM inference providers (OpenAI, Anthropic, Gemini, etc.).

No Package No Dependents
Maintenance 10 / 25
Adoption 9 / 25
Maturity 15 / 25
Community 16 / 25

How are scores calculated?

Stars

71

Forks

12

Language

Python

License

Apache-2.0

Last pushed

Feb 18, 2026

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/agents/RouteWorks/RouterArena"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.