train-600-attention
Training repo for Toy GPT: Context-2 model with attention + small domain corpus (030_analytics.txt). Attention requires scale.
- 1
- Python
- MIT
- 7 mo ago
Training repo for Toy GPT: Context-2 model with attention + small domain corpus (030_analytics.txt). Attention requires scale.
Training repo for Toy GPT: Context-2 model with embeddings + small domain corpus (030_analytics.txt). Much more efficient use of space.