lion-pytorch
🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
- 2.2k
- Python
- MIT
- 5 mo ago
🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
Fork of Karpathy's autoresearch with novelty-search-inspired autonomous search, run memory, and agentic review.