ai-inference

Open repos and models their makers tagged ai-inference, most starred first. The same for everyone.

AI on my own machineRepo

llama-cpp-power8

llama.cpp optimizations for IBM POWER8: vec_perm non-bijunctive collapse, PSE hardware entropy, DCBT prefetch. Sovereign inference. Part of the Proof of Physical AI stack.

  • 126
  • C
  • Apache-2.0
  • 8 wk ago
ScottcjnTake it
AI on my own machineRepo

hummingbird

hummingbird is a lightweight, zero dependency runtime for massive open source Mixture of Experts (MoE) language models. It unifies SSD, RAM, and VRAM into a single intelligent memory hierarchy, enabling inference of models like GPT-OSS 120B, GLM, DeepSeek, Qwen, and more on consumer hardware

  • 68
  • C
  • 4 mo ago
prayangshuuuTake it
Images and videoRepo

ComfyUI_JosiaNodes

一套功能完整、轻量稳定的 ComfyUI 实用节点集。初衷是为了平替一些断更插件的功能,会持续更新一些新开发的节点插件。有好的创意可以发Issues,我会力所能及想办法做出来。全中文界面,原生控件,不依赖第三方库。

  • 50
  • JavaScript
  • MIT
  • 3 d ago
Josia-doitTake it
AI on my own machineRepo

NeuroHTTP

High-performance, AI-native server built from scratch in C + hand-written Assembly (SSE2/AVX2/AVX-512). Supports 10 AI providers — OpenAI, Groq, Anthropic Claude, Google Gemini, DeepSeek, Moonshot/Kimi, Zhipu GLM, Perplexity, Mistral AI, and local models via Ollama — all in one binary.

  • 53
  • C
  • 6 mo ago
okba14Take it
Voice and audioRepo

uPiper

Unity TTS plugin: Piper neural synthesis + pure C# G2P (6 languages: ja/en/zh/es/fr/pt) + Unity Inference Engine. Windows/Mac/Linux/Android/iOS/WebGL ready. High-quality voices for games & apps.

  • 34
  • C#
  • Apache-2.0
  • 5 mo ago
ayutazTake it
AI on my own machineRepo

ScalyticsCopilot

Apache 2.0-licensed open source operations stack for private AI inference with open models. Run LLMs (7B-70B) locally with vLLM, OpenAI-compatible API, web dashboard, chat UI, admin panel, and hardware monitoring.

  • 5
  • JavaScript
  • Apache-2.0
  • 9 d ago
scalyticsTake it
Developer toolsRepo

cli

Terminal CLI for ZeroGPU — an ultra-fast, compute-efficient inference provider for apps and agents. Purpose-built small and nano models on an edge network, with zero GPU infrastructure, serverless, and auto-scaling built in.

  • 1
  • TypeScript
  • MIT
  • 3 wk ago
zerogpuTake it
Search GitHub and Hugging Face for ai-inference

Get , open it once and sign in. Then come back here and press the button again.

ai-inference: open source repos and models on Take My Repo