mtp

Open repos and models their makers tagged mtp, most starred first. The same for everyone.

AI on my own machineRepo

MTPLX

The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.

  • 2.7k
  • Python
  • Apache-2.0
  • 13 d ago
youssofalTake it
Websites and appsRepo

skyward

An Android recovery written in Rust from scratch: decryption, installs and OTA updates, backup, WLAN, MTP, adb and fastbootd. Runs the phone's own drivers and services from its stock firmware.

  • 563
  • Rust
  • GPL-3.0
  • 6 d ago
kirklinTake it
AI on my own machineRepo

llamAmpere

llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx. 120+ TPS, 3300+ prefill for QFN 3.8.

  • 403
  • C++
  • MIT
  • 8 h ago
JakeATXTake it
AI on my own machineRepo

RustingStrata

Pure-Rust LLM inference engine for GGUF (Qwen, DeepSeek, GLM, Hy4, Flint). Runs models bigger than your VRAM on CUDA and Vulkan, with MTP drafts and an OpenAI/Anthropic server. 12 GB RTX 3060 vs llama.cpp: Qwen3.6-35B-A3B UD-Q5_K_M 80.5 vs 64.4 tok/s, Flint UD-Q5_K_XL 64.6 vs 48.6. With MTP: 108 tok/s (UD-Q3_K_M), up to 160 (UD-Q2_K_XL).

  • 306
  • Rust
  • 5 h ago
GitHubRepo

intel-arc-pro-b70-inference-cookbook

Pinned Intel Arc Pro B60/B70 inference recipes, engine patches and measurement records: Qwen3.8-27B EXL3 on one card (262,144 context, 63 tok/s; MTP3 measured lossy on 27% of a fixed 329-item set), Nemotron Bolt 74B, Flash-Next, dual-card routes, and a machine-checked catalog where each speculative row states whether the drafter changes the answer.

  • 202
  • Python
  • MIT
  • 24 h ago
SergiioBTake it
AI on my own machineRepo

llama.cpp-v100

llama.cpp optimized for NVIDIA Tesla V100 (SM70). Qwen3.8-Flash-Next (MoE) with MTP on 1/2/3/6x V100-16GB at 262K context (6 GPUs: prefill 3402 tok/s at 200K; 2 GPUs on one socket: 2152 tok/s). Qwen3.8-27B with DFlash2 on 1-6 GPUs, up to 512K context. Multimodal, thinking, concurrent serving, built-in web UI.

  • 83
  • C++
  • GPL-3.0
  • 8 d ago
1115714829Take it
AI on my own machineRepo

NeveAI

NeveAI é uma plataforma de IA local privacy-first, desenvolvida para oferecer uma experiência de alta performance na execução de LLMs, reduzindo a dependência de grandes plataformas, assinaturas caras e APIs externas e servindo como uma alternativa offline, privada e independente.

  • 66
  • Python
  • 2 d ago
EtamusTake it
AI on my own machineRepo

strix-halo-engine-lab

Exact LLM inference engine written from scratch for AMD Strix Halo (gfx1151, ROCm/HIP). Qwen3.8-Flash-Next on one node or two replicas; DeepSeek V4.1 Flash across two nodes over USB4 with an optional RTX PRO. Speculative decoding bit-identical to greedy, up to 255 tok/s on coding chat. MiniMax and GLM next.

  • 37
  • C++
  • Apache-2.0
  • 2 d ago
hyukudanTake it
AI on my own machineRepo

llmash

Ollama-compatible LLM server. Beats vllm by 40% on single stream decode, and by 20% on multi stream decode, and beats ollama by much 2-4x. Made possible with custom CUDA kernels, MTP, speculation and its own 3-bit builds. Uncensors models in one command. Windows and Linux, NVIDIA. Optimized to not eat up ram.

  • 37
  • C++
  • Apache-2.0
  • 8 d ago
omgitsbaseTake it
AI on my own machineRepo

aviary-1m

Open models extended to 1M context with YaRN and certified needle by needle: Ornith, Gemma 4 uncensored, Qwen3.6 uncensored. MTP speculative decoding grafts, vision, full test harness.

  • 3
  • Python
  • 2 mo ago
AI on my own machineRepo

imatrix-gguf-quantizer

Bash script that turns a Hugging Face model into a full set of imatrix-quantized GGUF files for llama.cpp. It can also produce the vision projector (mmproj) and an MTP (multi-token prediction) head. Everything specific to one model lives in a small config file, quantizer.conf, so the same script works for any model llama.cpp can convert.

  • 0
  • Shell
  • MIT
  • 2 d ago
nerunTake it
Search GitHub and Hugging Face for mtp

Get , open it once and sign in. Then come back here and press the button again.