llama-cpp

Open repos and models their makers tagged llama-cpp, most starred first. The same for everyone.

Run my own servicesRepo

ODS

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.

  • 7.8k
  • Python
  • Apache-2.0
  • 3 h ago
OsmanticTake it
DatabasesRepo

DigUp

Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.

  • 6.5k
  • Swift
  • MIT
  • 3 wk ago
ARahim3Take it
Language and translationRepo

overlay-translator

无需 ROOT 的开源 Android 屏幕实时翻译工具,适合游戏、视觉小说和漫画。支持端侧与云端 OCR、离线 LLM、多种翻译服务和文字朗读(TTS),译文可直接显示在画面上。Open-source no-root Android real-time screen translator for games, visual novels, and manga. Supports on-device and cloud OCR, offline LLMs, multiple translation services, on-screen translations, and text-to-speech (TTS).

  • 1.3k
  • Kotlin
  • Apache-2.0
  • 2 d ago
ciddwdTake it
AI on my own machineRepo

jev

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

  • 971
  • C++
  • MIT
  • 4 wk ago
feder-crTake it
AI on my own machineRepo

hob

An easier way to use AI on your own computer. A free, open-source alternative to Claude and ChatGPT that runs open-weight models like Gemma and gpt-oss locally on Mac, Windows and Linux. Private, and works offline.

  • 551
  • TypeScript
  • MIT
  • 3 wk ago
FrigadeHQTake it
AI on my own machineRepo

OmniSpace

本地优先的全栈 AI 创作工作站:AI对话 · AI漫画 · 漫剧创作 · 写作台 · 知识学习五大模块;vLLM / llama.cpp / Transformers 多引擎本地推理,显存智能调度、舱壁隔离自愈、仅供学习使用,欢迎交流指正。(最新进度(除插件系统)受到协议限制,暂时无法提交到仓库)

  • 536
  • Python
  • 8 wk ago
Yzw202011Take it
AI on my own machineRepo

llamAmpere

llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx. 120+ TPS, 3300+ prefill for QFN 3.8.

  • 393
  • C++
  • MIT
  • 5 h ago
JakeATXTake it
AI on my own machineRepo

MACaQ

SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch.

  • 357
  • C++
  • Apache-2.0
  • 21 h ago
huawei-cslTake it
AI on my own machineRepo

VodMax

Self-hosted media center for live TV, a Jellyfin and Plex alternative: M3U and Xtream Codes (IPTV) playlists you are entitled to use, EPG guide, timeshift, DVR, movies and series. Apps for Android, Android TV, Fire TV and LG webOS.

  • 79
  • Go
  • AGPL-3.0
  • 1 d ago
silirimTake it
Search GitHub and Hugging Face for llama-cpp

Send to which agent?

goes to the agent you pick.

Get , open it once and sign in. Then come back here and press the button again.