SnapKV
- 339
- Python
- Apache-2.0
- 17 mo ago
Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".
📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥
[EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA
🧠Awesome Memory-VLA: A curated list of Visual-Language-Action models with memory
LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models
Code and data releases for the paper -- DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory
🔥 [ICLR 2025] Official Benchmark Toolkits for "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"
This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
[ICLR 2025] Official code repository for "TULIP: Token-length Upgraded CLIP"
[NeurIPS 2025] HoPE: Hybrid of Position Embedding for Long Context Vision-Language Models
🔥 [ICLR 2025] Official PyTorch Model "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"
Elastic Attention: Test-time Adaptive Sparsity Ratios for Efficient Transformers
Pure PyTorch + 🤗 Transformers reimplementation of Megalodon (CEMA + chunked attention) - readable, hackable, no CUDA kernels required