llm-compressor

Open repos and models their makers tagged llm-compressor, most starred first. The same for everyone.

AI on my own machineRepo

quant-lab

Quantization pipelines for local inference: recipes, exact module coverage, and side-by-side evaluation (KLD / top-1 / PPL, decode + TTFT) against both full-precision and vendor checkpoints.

  • 0
  • Python
  • Apache-2.0
  • 4 wk ago
ozdokTake it
Search GitHub and Hugging Face for llm-compressor

Get , open it once and sign in. Then come back here and press the button again.