edge-inference

Open repos and models their makers tagged edge-inference, most starred first. The same for everyone.

AI on my own machineRepo

pocketlfm

PocketLFM — run Liquid AI's LFM2.5 large language model fully on-device on Android. Offline, private, no cloud. Open-source edge AI via llama.cpp (GGUF). First independent open-source Android app to run LFM2.5 outside Liquid's own Apollo/LEAP.

  • 4
  • C++
  • MIT
  • 5 mo ago
Jeevav62Take it
Developer toolsRepo

cli

Terminal CLI for ZeroGPU — an ultra-fast, compute-efficient inference provider for apps and agents. Purpose-built small and nano models on an edge network, with zero GPU infrastructure, serverless, and auto-scaling built in.

  • 1
  • TypeScript
  • MIT
  • 3 wk ago
zerogpuTake it
Search GitHub and Hugging Face for edge-inference

Get , open it once and sign in. Then come back here and press the button again.

edge-inference: open source repos and models on Take My Repo