realtime-inference

Open repos and models their makers tagged realtime-inference, most starred first. The same for everyone.

AI on my own machineRepo

FlashRT

FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is production VLA control for Pi0, Pi0.5, GROOT N1.6, and Pi0-FAST. Also support llm e.g, qwen3.6-27B

  • 818
  • C++
  • Apache-2.0
  • 1 d ago
Search GitHub and Hugging Face for realtime-inference

Get , open it once and sign in. Then come back here and press the button again.