trnrt
The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.
- 1.6k
- Python
- Apache-2.0
- 3 d ago
The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.
AI/ML and HPC at planetary scale. One API. Every Accelerator. Any Region. MIT-0 licensed.
Automatic speech recognition model, used with transformers.
Automatic speech recognition model, used with transformers.
Automatic speech recognition model, used with transformers.
Automatic speech recognition model, used with transformers.