disaggregated-serving
moe-disaggregation-benchmark
Does prefill/decode disaggregation pay for an MoE model? SLO-first goodput benchmark of Qwen3-30B-A3B on 4x H100 and 8x A100 with vLLM, llm-d and NVIDIA Dynamo, with per-request data.
- 0
- Python
- Apache-2.0
- 4 wk ago
