pingala8-llm
2-bit LLMs for llama.cpp: 85% smaller, beats IQ2_XXS at the same size, no retraining. One-click Windows build.
- 3
- Python
- Apache-2.0
- 3 wk ago
Genrius-AI
Built from Genrius-AI's public GitHub profile. Not on Take My Repo yet, so there are no posts or updates here.
2-bit LLMs for llama.cpp: 85% smaller, beats IQ2_XXS at the same size, no retraining. One-click Windows build.