STRING
[ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
- 83
- Python
- MIT
- 24 mo ago
[ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
PyTorch implementation of RoFormer's Rotary Position Embeddings (RoPE) with comprehensive tests, benchmarks, and documentation. Used in LLaMA, PaLM, GPT-NeoX.