rocm

Open repos and models their makers tagged rocm, most starred first. The same for everyone.

AI on my own machineRepo

gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

  • 6.1k
  • Python
  • Apache-2.0
  • 11 h ago
gpustackTake it
AI on my own machineRepo

project-maya

Run GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- and Anthropic-compatible API.

  • 3k
  • C++
  • MIT
  • 10 h ago
mw00Take it
AI on my own machineRepo

yzma

Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

  • 677
  • Go
  • 1 d ago
hybridgroupTake it
Images and videoRepo

XB_ToolBox

XB_ToolBox: An easy-to-use ComfyUI custom node suite that streamlines workflow generation. Featuring exclusive data-flow logic and pioneering experimental kernel optimizations dedicated to the native AMD GPU ecosystem.

  • 467
  • Python
  • Apache-2.0
  • 2 d ago
wjluoxiaoTake it
AI on my own machineRepo

ming-voice

Low-latency local speech-to-speech voice assistant with Ming-3.0-audio-tiny on AMD and Nvidia GPUs. Easy setup on Windows and Linux

  • 449
  • Python
  • MIT
  • 5 h ago
JMS1717Take it
AI on my own machineRepo

kyojin

Kyojin: open-source engine that runs 100 GB-class open models (GLM-5.3, Qwen3.8, DeepSeek V4.1) on one desktop machine. AMD Strix Halo, NVIDIA RTX and Apple Mac. OpenAI API, built on ExLlamaV3.

  • 243
  • Python
  • MIT
  • 1 d ago
Yamz-LabsTake it
Computer visionRepo

MIVisionX

AMD MIVisionX is a computer vision toolkit built around a highly optimized, conformant open-source implementation of the Khronos OpenVX™ 1.3.2 specification. As of the 4.0.0 release, MIVisionX ships three components: the AMD OpenVX™ engine, the AMD RPP OpenVX extension, and the RunVX graph executor — across CPU, HIP, and OpenCL backends.

  • 218
  • C++
  • MIT
  • 3 h ago
ROCmTake it
AI on my own machineRepo

kindi

Kindi 0.6.1: fast local LLM inference on low-cost GPUs and CPUs. DeepSeek-V4.1-Flash (552B) at 18.7 tok/s on one RTX 3060 12 GB with a dual-Xeon DDR4 server. Ternary Bonsai 2B-27B, AH-Nanbeige4.3-33B, Nemotron 3.5 Lightning 30B-A3B. NVIDIA from the Quadro K420 to the RTX 50 series, AMD Radeon graphics, Windows and Linux. OpenAI-compatible server.

  • 191
  • Python
  • AGPL-3.0
  • 2 d ago
ahtxTake it
AI on my own machineRepo

Qwenox

An inference framework customized for AI MAX 395, compatible with both Linux and Windows, and supports deploying only qwen3.8-flash-next. This project is for reference and learning purposes only. 为AI MAX 395定制的推理框架,Linux和Windows通用,只能部署qwen3.8-flash-next。本项目仅供参考学习使用。

  • 147
  • C++
  • AGPL-3.0
  • 11 h ago
AI on my own machineRepo

hal0

Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + systemd.

  • 87
  • Python
  • Apache-2.0
  • 6 h ago
Hal0aiTake it
AI on my own machineRepo

Abyss

Run 50-280 GB MoE LLMs (DeepSeek V4/V4.1 Flash, GLM-5.3-Flash, Qwen3.8-Flash-Next, Ornith) on one consumer GPU: experts spread over VRAM, RAM and NVMe SSD. Browser chat + OpenAI/Anthropic APIs. CUDA, ROCm, DGX Spark.

  • 40
  • C++
  • MIT
  • 4 h ago
zephel01Take it
GitHubRepo

radeon_compute_profiler

The Radeon Compute Profiler (RCP) is a performance analysis tool that gathers data from the API run-time and GPU for OpenCL™ and ROCm/HSA applications. This information can be used by developers to discover bottlenecks in the application and to find ways to optimize the application's performance.

  • 85
  • C++
  • MIT
  • 6 y ago
AI on my own machineRepo

strix-halo-llm

DeepSeek-V4.1-Flash (1M context) and GLM-5.3-Flash on a BOSGAME M5 (Ryzen AI Max+ 395, Radeon 8060S, 128 GiB) with two RX 7900 XTX over OCuLink: pinned Ansible recipes and measured results. Also the M5-only Qwen and DeepSeek setups.

  • 33
  • Python
  • MIT
  • 5 h ago
pepusczTake it
AI on my own machineRepo

libstrix

Fast vLLM on AMD Strix Halo: one docker command for Qwen, Gemma, LFM and more, up to 31x faster prefill and ~2x decode vs stock vLLM at long context.

  • 22
  • Python
  • MIT
  • 4 h ago
asf0Take it
AI on my own machineRepo

TitanVault

A turnkey, fully-local AI workstation engineered for the AMD Ryzen AI Max+ 395. LLM inference, voice, document parsing, browser automation, agents — all on-device.

  • 7
  • Python
  • Apache-2.0
  • 4 mo ago
kaka86mmTake it
AI on my own machineRepo

beam

Pure-Python drop-in subset of Ray's API that makes vLLM distributed inference work across nodes. ~1,400 LoC, one dependency, bind-mount into the stock vLLM image. NVIDIA + AMD, validated cross-node.

  • 2
  • Python
  • AGPL-3.0
  • 5 wk ago
maci0Take it
Search GitHub and Hugging Face for rocm

Get , open it once and sign in. Then come back here and press the button again.