strata

Open repos and models their makers tagged strata, most starred first. The same for everyone.

AI on my own machineRepo

Xolotl

Xolotl: run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM): ~33 tok/s on agent tasks, ~41 in fast mode, 512K context. Plus GLM-5.3-Flash, Qwen3.8 and LFM3-Omni. MoE experts tiered across VRAM, pinned RAM and NVMe, with Xolotl Direct NVMe->VRAM. OpenAI + Anthropic API.

  • 545
  • C++
  • MIT
  • 12 h ago
AI on my own machineRepo

Speedy

Qwen3.8-Flash-Next (125B MoE) up to 1M context on one or two RTX cards (tuned on 3080 10gb). A measured, tuned and benchmarked fork of Strata.

  • 101
  • C++
  • 13 h ago
DevDock-AITake it
AI on my own machineRepo

local-ai-harness

Local AI harness for coding agents: detects your GPU and RAM, recommends an engine and model, sizes limits to your context. Any OpenAI-compatible engine or cloud model. Tuned for AMD Strix Halo.

  • 38
  • Python
  • MIT
  • 6 h ago
aic0d3rTake it
AI on my own machineRepo

stratoscope

A live gauge for your local LLM inference engine in the menu bar: prefill and decode speed, prompt-cache hits, context, RAM and GPU. Works with Strata.

  • 9
  • C#
  • MIT
  • 10 d ago
yosephyneTake it
AI on my own machineRepo

strata-pc-simulator

3D PC-building simulator for local MoE LLM inference — drag real parts, press power, see decode/prefill/TTFT respond. Vanilla JS + Three.js, calibrated against real measurements.

  • 3
  • JavaScript
  • MIT
  • 2 wk ago
PiccataProTake it
Search GitHub and Hugging Face for strata

Get , open it once and sign in. Then come back here and press the button again.

strata: open source repos and models on Take My Repo