glm53-flash-cmp170hx-recipe
GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, one-command container install
- 94
- Python
- MIT
- 4 wk ago
GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, one-command container install
DeepSeek-V4-Flash-Vision-Exp multimodal serving on 4× CMP 170HX (unlocked GA100, sm_80, PP4, 512k ctx, DSpark)