Llm Request Routing Transformer Models

There are 3 llm request routing models tracked. The highest-rated is anyscale/llm-router at 33/100 with 246 stars.

Get all 3 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=llm-request-routing&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	anyscale/llm-router Tutorial for building LLM router	33	Emerging	246	Python
2	llm-semantic-router/vllm-router vLLM Router	29	Experimental	55	Python
3	ashwathnakate/adaptive_llm_inference_router An intelligent LLM inference gateway that dynamically routes user queries to...	22	Experimental	1	Python