cpu-inference

Open repos and models their makers tagged cpu-inference, most starred first. The same for everyone.

AI on my own machineRepo

jev

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

  • 971
  • C++
  • MIT
  • 4 wk ago
feder-crTake it
Voice and audioRepo

vui

Vui Nano — a small, context-aware text-to-speech model trained on real conversations. 219M active params (305M total), Apache 2.0, voice cloning, streaming, runs on CPU (dependency-free C build). Ships with a full real-time voice assistant: WebRTC, ASR, local LLM, OpenAI Realtime API compatible.

  • 782
  • Python
  • 6 wk ago
fluxions-aiTake it
AI on my own machineRepo

janas

37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

  • 735
  • C
  • GPL-3.0
  • 5 h ago
prabanta-devTake it
Search GitHub and Hugging Face for cpu-inference

Send to which agent?

goes to the agent you pick.

Get , open it once and sign in. Then come back here and press the button again.