fp4

Open repos and models their makers tagged fp4, most starred first. The same for everyone.

GitHubRepo

TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

  • 3.6k
  • Python
  • Apache-2.0
  • 56 min ago
NVIDIATake it
Search GitHub and Hugging Face for fp4

Get , open it once and sign in. Then come back here and press the button again.