on-device-inference

Open repos and models their makers tagged on-device-inference, most starred first. The same for everyone.

AI on my own machineRepo

squish

⚡️ The fastest way to run local LLMs on Apple Silicon — sub-second model loads, beats Ollama on throughput, tail latency, and full-response time. OpenAI/Ollama-compatible. No cloud, no API keys.

  • 20
  • Python
  • 2 d ago
konjoaiTake it
Search GitHub and Hugging Face for on-device-inference

Get , open it once and sign in. Then come back here and press the button again.

on-device-inference: open source repos and models on Take My Repo