ai-inference-server

Open repos and models their makers tagged ai-inference-server, most starred first. The same for everyone.

AI on my own machineRepo

NeuroHTTP

High-performance, AI-native server built from scratch in C + hand-written Assembly (SSE2/AVX2/AVX-512). Supports 10 AI providers — OpenAI, Groq, Anthropic Claude, Google Gemini, DeepSeek, Moonshot/Kimi, Zhipu GLM, Perplexity, Mistral AI, and local models via Ollama — all in one binary.

  • 53
  • C
  • 6 mo ago
okba14Take it
Search GitHub and Hugging Face for ai-inference-server

Get , open it once and sign in. Then come back here and press the button again.