post-training-quantization

Open repos and models their makers tagged post-training-quantization, most starred first. The same for everyone.

GitHubRepo

micronet

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 grou

  • 2.3k
  • Python
  • MIT
  • 19 mo ago
666DZY666Take it
Images and videoRepo

TFMQ-DM

[CVPR 2024 Highlight & TPAMI 2025] This is the official PyTorch implementation of "TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models".

  • 111
  • Jupyter Notebook
  • Apache-2.0
  • 14 mo ago
ModelTCTake it
AI on my own machineRepo

QLLM

[ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models"

  • 39
  • Python
  • Apache-2.0
  • 3 y ago
ModelTCTake it
AI on my own machineRepo

pingala8-llm

2-bit LLMs for llama.cpp: 85% smaller, beats IQ2_XXS at the same size, no retraining. One-click Windows build.

  • 3
  • Python
  • Apache-2.0
  • 3 wk ago
Genrius-AITake it
Search GitHub and Hugging Face for post-training-quantization

Get , open it once and sign in. Then come back here and press the button again.