SmartEvict-Semantic-Cache-Eviction
A learned, cost-aware eviction policy for semantic LLM caches that replaces heuristic policies like LRU/FIFO with a lightweight offline-trained model, improving regeneration-token savings while maintaining safe LRU fallback.
- 3
- Python
- MIT
- 4 mo ago
