quant.cpp
LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.
- 407
- C
- Apache-2.0
- 7 mo ago
LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.
Pure C inference engine for Qwen3-TTS text-to-speech. No Python, no PyTorch — just C and BLAS. Supports 0.6B and 1.7B models, 9 voices, 10 languages.