awesome-llm-routing-cascading
Dynamic Model Routing and Cascading for Efficient LLM Inference: A Survey
- 5
- 5 wk ago
Dynamic Model Routing and Cascading for Efficient LLM Inference: A Survey
In-browser LLM router over 12 models from 6 providers, with a cheapest-first cascade that grades and escalates