DeltaProduct
DeltaProduct is a new linear recurrent neural network architecture that uses products of generalized Householder matrices as state-transition matrices enabling better expressivity, state-tracking, and language modeling performance than DeltaNet.
- 19
- Python
- MIT
- 13 mo ago

