Llm Request Routing Transformer Models

There are 2 llm request routing models tracked. The highest-rated is anyscale/llm-router at 26/100 with 246 stars.

Get all 2 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=llm-request-routing&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Model Score Tier
1 anyscale/llm-router

Tutorial for building LLM router

26
Experimental
2 llm-semantic-router/vllm-router

vLLM Router

22
Experimental