InferBridge
Windows-first OpenAI-compatible local LLM server powered by OpenVINO GenAI for Intel CPU/GPU/NPU, with chat UI, model conversion, and setup scripts.
- 56
- Python
- MIT
- 4 d ago
Windows-first OpenAI-compatible local LLM server powered by OpenVINO GenAI for Intel CPU/GPU/NPU, with chat UI, model conversion, and setup scripts.
Fast, calibrated System-1 decisions (Jev/Laya-style) on your NPU/GPU, plus per-prompt skill & MCP tool leasing that cuts agent context ~99%.