train-600-attention
Training repo for Toy GPT: Context-2 model with attention + small domain corpus (030_analytics.txt). Attention requires scale.
- 1
- Python
- MIT
- 7 mo ago
Training repo for Toy GPT: Context-2 model with attention + small domain corpus (030_analytics.txt). Attention requires scale.
Training repo for Toy GPT: Context-2 model with embeddings + small domain corpus (030_analytics.txt). Much more efficient use of space.
Training repo for Toy GPT: Context-3 model + small neutral corpus (000_cat_dog.txt)
Training repo for Toy GPT: context-3 model + small structured corpus (001_animals.txt)
Training repo for Toy GPT: bigram model + small domain corpus (010_llm_glossary.txt)
Training repo for Toy GPT: unigram + small neutral corpus (000_cat_dog.txt)