Alternatives to codewithdark-git/QuantLLM

codewithdark-git/QuantLLM: QuantLLM is a Python library designed for developers, researchers, and teams who want to fine-tune and deploy large language models (LLMs) efficiently using 4-bit and 8-bit quantization techniques. License MIT. Below, the open repos Take My Repo keeps on the same subjects, most starred first. Stars measure popularity, not quality.

AI on my own machineRepo

marlin

FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

  • 1.2k
  • Python
  • Apache-2.0
  • 2 y ago
IST-DASLabTake it
AI agentsRepo

ECC

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

  • 309k
  • JavaScript
  • MIT
  • 3 d ago
affaan-mTake it
Language and translationRepo

laya

Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ languages, with a router that picks the right checkpoint per request.

  • 36k
  • Python
  • Apache-2.0
  • 1 d ago
Developer toolsRepo

Codewhale

An open-source coding agent for your terminal, written in Rust. It works with any model, can split one task across several agents, and every line of it is yours to read.

  • 41k
  • Rust
  • MIT
  • 2 h ago
codewhale-hqTake it

Side by side

NameStarsLicenseLanguageLast changeIn commonCompare
codewithdark-git/QuantLLM18MITPython3 wk ago
IST-DASLab/marlin1.2kApache-2.0Python2 y ago4bit, llm, quantizationCompare
pico-8/awesome-PICO-83.1kCC0-1.0Unknown4 mo ago8bitCompare
debpalash/VoiceStudio116kAGPL-3.0Python2 h agohuggingfaceCompare
affaan-m/ECC309kMITJavaScript3 d agollmCompare
HKUDS/nanobot50kMITPython4 h agoSame needCompare
radiumcoders/Evil-Buttons302Apache-2.0TypeScript8 d ago8bitCompare
NandhaKishorM/laya36kApache-2.0Python1 d agohuggingfaceCompare
NousResearch/hermes-agent265kMITPython3 h agollmCompare
codewhale-hq/Codewhale41kMITRust2 h agollmCompare
zOrOjUrO/4BitCPU-Simulation-Logisim4None declaredUnknown4 y ago4bitCompare
FujiNetWIFI/fujinet-firmware300GPL-3.0C22 h ago8bitCompare
huggingface/agents-course35kApache-2.0MDX6 d agohuggingfaceCompare

Read from GitHub and Hugging Face. A value a source does not give is shown as unknown, never guessed.

Get , open it once and sign in. Then come back here and press the button again.