quant.cpp
LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.
- 407
- C
- Apache-2.0
- 7 mo ago
LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.
Multi-Algorithm Data Compression for Embedded Systems in Header-Only C++