kueue
gpustack-operator
Manage heterogeneous accelerators, vGPU slicing, shared KV cache, model delivery, and inference workloads.
- 7
- Go
- Apache-2.0
- 7 h ago
goodput-stack
Self-hosted LLM inference on Kubernetes: agentgateway + Gateway API Inference Extension + llm-d EPP, vLLM (T4) and llama.cpp, KEDA queue-depth autoscaling, Kueue/DRA GPU scheduling, Prometheus/Grafana, and an emulated BGP/EVPN leaf-spine AI fabric with RoCE v2 design.
- 1
- Python
- Apache-2.0
- 3 wk ago