4bit

Open repos and models their makers tagged 4bit, most starred first. The same for everyone.

AI on my own machineRepo

QuantLLM

QuantLLM is a Python library designed for developers, researchers, and teams who want to fine-tune and deploy large language models (LLMs) efficiently using 4-bit and 8-bit quantization techniques.

  • 18
  • Python
  • MIT
  • 2 wk ago
codewithdark-gitTake it
Search GitHub and Hugging Face for 4bit

Send to which agent?

goes to the agent you pick.

Get , open it once and sign in. Then come back here and press the button again.

4bit: open source repos and models on Take My Repo