LLaMA-Omni
LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.
- 3.1k
- Python
- Apache-2.0
- 18 mo ago
LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.
[ICLR 2025] SOTA discrete acoustic codec models with 40/75 tokens per second for audio language modeling
AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
[ICCV 2025] Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"
Streamable Text-to-Speech model using a language modeling approach, without vector quantization
End-to-end speech model research: waveform encoding, causal decoding, codec tokens, joint losses and streaming.