llama-cpp
SenseVoice
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.
- 9.8k
- C
- MIT
- 7 wk ago
ODS
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
- 7.8k
- Python
- Apache-2.0
- 3 h ago
DigUp
Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.
- 6.5k
- Swift
- MIT
- 3 wk ago
atomic-agent
Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
- 3.7k
- TypeScript
- MIT
- 3 h ago
claude-code-local
Hit your Claude Code usage limit? Keep going free and offline on a local model: Qwen 3.8, Gemma 4, and Qwen 4 the day it ships. Runs on Apple Silicon Macs (MLX), Linux and Windows (llama.cpp) with no API key. Your code stays home.
- 3.5k
- Python
- MIT
- 6 h ago
Huihui-Qwen3.8-27B-abliterated-GGUF
Image text to text model, used with transformers.
- 2.3k
- 4.3M
- apache-2.0
- 3 mo ago
yogurt
Private AI meeting notes that stay on your computer. A free, open-source alternative to Granola for Mac, Windows and Linux.
- 2.1k
- TypeScript
- MIT
- 3 h ago
Observer
The micro-agent orchestrator that monitors anything for you. Running completely locally. Open Source.
- 1.8k
- TypeScript
- AGPL-3.0
- 3 d ago
Fun-ASR
Fun-ASR speech recognition models, with native Hugging Face Transformers support for Fun-ASR-Nano and separate FunASR, vLLM and llama.cpp deployment paths.
- 1.6k
- C
- Apache-2.0
- 9 d ago
llama-modchip
Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).
- 1.3k
- Python
- Apache-2.0
- 12 h ago
overlay-translator
无需 ROOT 的开源 Android 屏幕实时翻译工具,适合游戏、视觉小说和漫画。支持端侧与云端 OCR、离线 LLM、多种翻译服务和文字朗读(TTS),译文可直接显示在画面上。Open-source no-root Android real-time screen translator for games, visual novels, and manga. Supports on-device and cloud OCR, offline LLMs, multiple translation services, on-screen translations, and text-to-speech (TTS).
- 1.3k
- Kotlin
- Apache-2.0
- 2 d ago
backburner
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
- 1.2k
- Python
- MIT
- 11 d ago
Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF
Image text to text model, used with gguf.
- 1.1k
- 4.2M
- apache-2.0
- 7 wk ago
SiliconScope
Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
- 1k
- Swift
- MIT
- 7 d ago
humanizer-local-model
Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts
- 986
- Python
- Apache-2.0
- 4 wk ago
jev
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
- 971
- C++
- MIT
- 4 wk ago
kapitsa
Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai
- 820
- C++
- Apache-2.0
- 2 h ago
hob
An easier way to use AI on your own computer. A free, open-source alternative to Claude and ChatGPT that runs open-weight models like Gemma and gpt-oss locally on Mac, Windows and Linux. Private, and works offline.
- 551
- TypeScript
- MIT
- 3 wk ago
OmniSpace
本地优先的全栈 AI 创作工作站:AI对话 · AI漫画 · 漫剧创作 · 写作台 · 知识学习五大模块;vLLM / llama.cpp / Transformers 多引擎本地推理,显存智能调度、舱壁隔离自愈、仅供学习使用,欢迎交流指正。(最新进度(除插件系统)受到协议限制,暂时无法提交到仓库)
- 536
- Python
- 8 wk ago
llamAmpere
llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx. 120+ TPS, 3300+ prefill for QFN 3.8.
- 393
- C++
- MIT
- 5 h ago
strix-halo-guide
Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.
- 372
- Python
- MIT
- 8 d ago
big-blue-fish-desktop-pet
蓝色大肥鱼 Windows AI 桌宠,内置 4B 本地大模型,以鲸鱼娘人设结合天气、科技新闻和当前应用,通过文字气泡温柔陪伴。支持一键安装与离电暂停推理。Big Blue Fish desktop pet with local LLM.
- 363
- C#
- Apache-2.0
- 5 d ago
MACaQ
SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch.
- 357
- C++
- Apache-2.0
- 21 h ago
localmind
A mobile application designed to provide a beautiful, fast, and privacy-respecting interface for on device LLM and local LLM servers and cloud providers
- 334
- Dart
- MIT
- 5 d ago
CarWatch
Your car as a chat-room agent: Raspberry Pi 5 + dashcam + local AI. CodeWatch's sibling for the garage.
- 305
- Python
- AGPL-3.0
- 6 wk ago
VodMax
Self-hosted media center for live TV, a Jellyfin and Plex alternative: M3U and Xtream Codes (IPTV) playlists you are entitled to use, EPG guide, timeshift, DVR, movies and series. Apps for Android, Android TV, Fire TV and LG webOS.
- 79
- Go
- AGPL-3.0
- 1 d ago
Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF
Text generation model, used with transformers.
- 2
- 461
- mit
- 3 wk ago