llm-runtime

Open repos and models their makers tagged llm-runtime, most starred first. The same for everyone.

AI agentsRepo

forge

Forge is the open-source runtime for Anthropic's Agent Skills standard — built for the agent that runs next to a service, in your environment, on infrastructure you already operate. Write a SKILL.md. Compile to a portable, hardened agent. Deploy it anywhere containers run: Kubernetes, on-prem, air-gapped, embedded in CI, or as an A2A endpoint.

  • 221
  • Go
  • Apache-2.0
  • 2 d ago
initializTake it
AI on my own machineRepo

hummingbird

hummingbird is a lightweight, zero dependency runtime for massive open source Mixture of Experts (MoE) language models. It unifies SSD, RAM, and VRAM into a single intelligent memory hierarchy, enabling inference of models like GPT-OSS 120B, GLM, DeepSeek, Qwen, and more on consumer hardware

  • 68
  • C
  • 4 mo ago
prayangshuuuTake it
Search GitHub and Hugging Face for llm-runtime

Get , open it once and sign in. Then come back here and press the button again.