awq

Open repos and models their makers tagged awq, most starred first. The same for everyone.

AI on my own machineRepo

vllm-windows-build

Native Windows vLLM 0.33.0 (Python 3.13/CUDA 13.0), plus a Python 3.14/CUDA 13.2 build; older versions on the Releases page. PyTorch 2.14, FlashAttention/Rust, OpenAI serving, 10 KV formats, Multi-TurboQuant, experimental CPU/NVMe KV offload. No WSL or Docker.

  • 68
  • Python
  • MIT
  • 3 d ago
aivrarTake it
AI on my own machineRepo

llm-inference-bench

Benchmark self-hosted LLM inference across engines (vLLM, Ollama) and quantisation levels (FP16 / INT8 / AWQ / GPTQ). Concurrency sweeps, TTFT / TPOT / P99 tail latency, VRAM curves, Prometheus + Grafana, self-contained HTML reports.

  • 2
  • Python
  • MIT
  • 10 d ago
Search GitHub and Hugging Face for awq

Get , open it once and sign in. Then come back here and press the button again.

awq: open source repos and models on Take My Repo