llama-server
TurboLLM
Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine in one command. No Electron, no Python, offline-first.
- 298
- TypeScript
- 4 d ago
LlamaForge
Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every llama-server flag per model, one-click llama.cpp updates, several models at once, and Embers (local agents whose quotes are checked by code). Windows · Linux · macOS.
- 128
- Python
- MIT
- 2 wk ago
LlamaServerLauncherAvalonia
Corrallama: desktop app to run and manage llama.cpp llama-server instances - launch profiles, llama.cpp build updates, Hugging Face downloads, benchmarks and automatic parameter tuning. Windows, Linux, macOS.
- 83
- C#
- MIT
- 2 wk ago
rs-agent
Rs-Agent · Rust AI agent harness for local llama-server, Omarchy, and T3 Code.
- 1
- Rust
- MIT
- 7 h ago
mcpwith-codemode-cc
EDU AI LAB: codemode - new way how LLM can exec code inside MCP srv (Contrast & Compare old ways)
- 0
- Python
- MIT
- 4 wk ago
localai-isnot-cheap
EDU AI LAB: Local AI is not CHEAP at ALL! - Every AI token carries a COST! How to measure them?
- 0
- Python
- MIT
- 3 mo ago
katabasis
A drop-in replacement for llama-bench that measures across the regimes your model actually sees — for llama.cpp's llama-server.
- 0
- Python
- MIT
- 6 mo ago

