sparsity
neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
- 2.7k
- Python
- Apache-2.0
- 5 h ago
model-optimization
A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
- 1.6k
- Python
- Apache-2.0
- 17 min ago
clip-distillation
Zero-label image classification via OpenCLIP knowledge distillation
- 145
- Python
- 3 y ago
sparse-evolutionary-artificial-neural-networks
Always sparse. Never dense. But never say never. A Sparse Training repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boost Deep Learning scalability on various aspects (e.g. memory and computational time efficiency, representation and generalization power).
- 264
- Python
- MIT
- 5 y ago
nncf
Neural Network Compression Framework for enhanced OpenVINO™ inference
- 1.2k
- Python
- Apache-2.0
- 11 h ago
SMC-Bench
[ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen, Tianjin Huang, AJAY KUMAR JAISWAL, Zhangyang Wang
- 28
- Python
- 3 y ago
R-Sparse
[ICLR'25] R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference
- 21
- Python
- 19 mo ago
Progressive-Pruning
Official pytorch code for "APP: Anytime Progressive Pruning" (DyNN @ ICML, 2022; CLL @ ACML, 2022, SNN @ ICML, 2022 and SlowDNN 2023)
- 16
- Python
- 4 y ago
SCoMMER
The official PyTorch code for AAAI'23 Paper "Sparse Coding in a Dual Memory System for Lifelong Learning"
- 12
- Python
- MIT
- 4 y ago
QuantumSEA
[QCE 2023]"QuantumSEA: In-Time Sparse Exploration for Noise Adaptive Quantum Circuits" Tianlong Chen, Zhenyu Zhang, Hanrui Wang, Jiaqi Gu, Zirui Li, David Z Pan, Frederic T Chong, Song Han, Zhangyang Wang
- 2
- Python
- MIT
- 3 y ago

