ryzenai-npu-lab
LLM and speech-to-text on the AMD Ryzen AI NPU with custom AI Engine kernels: LFM2.5-230M at 58 tok/s, Parakeet TDT 0.6B encoder at 185 ms per 10 s audio with FP32 accuracy. IRON/MLIR-AIE, XRT.
- 5
- Python
- MIT
- 3 d ago
LLM and speech-to-text on the AMD Ryzen AI NPU with custom AI Engine kernels: LFM2.5-230M at 58 tok/s, Parakeet TDT 0.6B encoder at 185 ms per 10 s audio with FP32 accuracy. IRON/MLIR-AIE, XRT.
AMD NPU Enabler (aie2p) for Strix Point/Krackan (Zen 5, Ryzen AI 7 350) on Ubuntu 26.04. Validated 4.3 TOPS / 68us latency. Includes amdxdna v0.11.0 & XRT v2.23.0.