turboquant

Open repos and models their makers tagged turboquant, most starred first. The same for everyone.

AI on my own machineRepo

taOS

Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).

  • 609
  • Python
  • AGPL-3.0
  • 12 h ago
jaylfcTake it
AI on my own machineRepo

llamAmpere

llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx. 120+ TPS, 3300+ prefill for QFN 3.8.

  • 403
  • C++
  • MIT
  • 12 h ago
JakeATXTake it
AI on my own machineRepo

vllm-windows-build

Native Windows vLLM 0.33.0 (Python 3.13/CUDA 13.0), plus a Python 3.14/CUDA 13.2 build; older versions on the Releases page. PyTorch 2.14, FlashAttention/Rust, OpenAI serving, 10 KV formats, Multi-TurboQuant, experimental CPU/NVMe KV offload. No WSL or Docker.

  • 68
  • Python
  • MIT
  • 1 d ago
aivrarTake it
AI on my own machineRepo

multi-turboquant

Unified KV-cache compression for LLM inference: 12 Python-native methods, guarded add-on composition and routing, analytical capacity simulation, Godzilla KVarN/TriAttention with SM86/SM89 qualification, CUDA weight sharing, and multi-GPU planning.

  • 30
  • Python
  • MIT
  • 6 wk ago
aivrarTake it
AI on my own machineRepo

orbit

your ai, your rules. — local AI desktop app with hardware-aware model matching, threaded conversations, and TurboQuant integration. no cloud, no subscription, no data leaving your device.

  • 4
  • TypeScript
  • 8 mo ago
savka777Take it
Search GitHub and Hugging Face for turboquant

Get , open it once and sign in. Then come back here and press the button again.

turboquant: open source repos and models on Take My Repo