consumer-gpu

Open repos and models their makers tagged consumer-gpu, most starred first. The same for everyone.

AI on my own machineRepo

HyperQwen

Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.

  • 2.7k
  • Python
  • Apache-2.0
  • 8 d ago
syv-aiTake it
AI on my own machineRepo

llamAmpere

llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx. 120+ TPS, 3300+ prefill for QFN 3.8.

  • 393
  • C++
  • MIT
  • 5 h ago
JakeATXTake it
Search GitHub and Hugging Face for consumer-gpu

Send to which agent?

goes to the agent you pick.

Get , open it once and sign in. Then come back here and press the button again.

consumer-gpu: open source repos and models on Take My Repo