Alternatives to quantumaikr/quant.cpp
llmfit
Hundreds of models & providers. One command to find what runs on your hardware.
- 39k
- Rust
- MIT
- 2 d ago
ECC
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
- 308k
- JavaScript
- MIT
- 21 h ago
ai-infra-book
《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
- 8.1k
- Python
- Apache-2.0
- 7 wk ago
Codewhale
An open-source coding agent for your terminal, written in Rust. It works with any model, can split one task across several agents, and every line of it is yours to read.
- 41k
- Rust
- MIT
- 51 min ago
Side by side
| Name | Stars | License | Language | Last change | In common | Compare |
|---|---|---|---|---|---|---|
| quantumaikr/quant.cpp | 407 | Apache-2.0 | C | 7 mo ago | ||
| typicode/lowdb | 23k | MIT | JavaScript | 8 mo ago | embeddable | Compare |
| AlexsJones/llmfit | 39k | MIT | Rust | 2 d ago | gguf, llm | Compare |
| LMCache/LMCache | 12k | Apache-2.0 | Python | 16 h ago | kv-cache, llm | Compare |
| HKUDS/nanobot | 50k | MIT | Python | 7 h ago | Same need | Compare |
| affaan-m/ECC | 308k | MIT | JavaScript | 21 h ago | llm | Compare |
| couchbase/fleece | 339 | None declared | C++ | 24 h ago | delta-compression | Compare |
| warmcat/libwebsockets | 5.4k | None declared | C | 24 h ago | embeddable | Compare |
| mozilla-ai/llamafile | 27k | None declared | C++ | 12 d ago | gguf | Compare |
| bojieli/ai-infra-book | 8.1k | Apache-2.0 | Python | 7 wk ago | kv-cache, llm, llm-inference | Compare |
| codewhale-hq/Codewhale | 41k | MIT | Rust | 51 min ago | llm | Compare |
| NousResearch/hermes-agent | 265k | MIT | Python | 1 h ago | llm | Compare |
| colyseus/schema | 175 | MIT | TypeScript | 2 d ago | delta-compression | Compare |







