Torch-Models
- 63
- 10 y ago
Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers"
Multilayer Perceptron implementation using feedforward, backpropagation, and gradient descent from scratch.