Alternatives to RustingStudio/RustingStrata

RustingStudio/RustingStrata: Pure-Rust LLM inference engine for GGUF (Qwen, DeepSeek, GLM, Hy4, Flint). Runs models bigger than your VRAM on CUDA and Vulkan, with MTP drafts and an OpenAI/Anthropic server. 12 GB RTX 3060 vs llama.cpp: Qwen3.6-35B-A3B UD-Q5_K_M 80.5 vs 64.4 tok/s, Flint UD-Q5_K_XL 64.6 vs 48.6. With MTP: 108 tok/s (UD-Q3_K_M), up to 160 (UD-Q2_K_XL). No license declared. Below, the open repos Take My Repo keeps on the same subjects, most starred first. Stars measure popularity, not quality.

AI on my own machineRepo

big-AGI

The AI workspace for experts. Switch across 800+ models mid-chat, tune 40+ parameters, Beam models side by side. BYO keys, self-hostable. Built on our native-protocol engine: reliable, hyper-configurable, and fast.

  • 7.2k
  • TypeScript
  • MIT
  • 6 h ago
enricorosTake it
AI agentsRepo

ECC

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

  • 307k
  • JavaScript
  • MIT
  • 18 h ago
affaan-mTake it
AI agentsRepo

axonhub

⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.

  • 5.5k
  • Go
  • Apache-2.0
  • 2 d ago
loopljTake it
AI agentsRepo

Rapid-MLX

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.

  • 4.2k
  • Python
  • Apache-2.0
  • 2 h ago
raullenchaiTake it

Side by side

NameStarsLicenseLanguageLast changeIn commonCompare
RustingStudio/RustingStrata306None declaredRust6 h ago
enricoros/big-AGI7.2kMITTypeScript6 h agoanthropic-api, llmCompare
debpalash/VoiceStudio115kAGPL-3.0Python1 h agocudaCompare
AlexsJones/llmfit39kMITRust2 d agogguf, llmCompare
vllm-project/vllm97kApache-2.0Python32 min agocuda, inference, llmCompare
HKUDS/nanobot50kMITPython3 h agolocal-llmCompare
affaan-m/ECC307kMITJavaScript18 h agollmCompare
looplj/axonhub5.5kApache-2.0Go2 d agoanthropic-api, llmCompare
mozilla-ai/llamafile27kNone declaredC++12 d agogguf, llama-cpp, local-llmCompare
ultralytics/yolov558kAGPL-3.0Python4 d agoinferenceCompare
codewhale-hq/Codewhale41kMITRust6 min agollm, local-llmCompare
NousResearch/hermes-agent265kMITPython39 min agollmCompare
raullenchai/Rapid-MLX4.2kApache-2.0Python2 h agoanthropic-api, local-llm, speculative-decodingCompare

Read from GitHub and Hugging Face. A value a source does not give is shown as unknown, never guessed.

Get , open it once and sign in. Then come back here and press the button again.