CodeRepairLM_tiny-LLM-scratch
A Python-only decoder-only Transformer built from scratch for automated Python code repair and bug fixing.
- 5
- Python
- 2 mo ago
A Python-only decoder-only Transformer built from scratch for automated Python code repair and bug fixing.
A complete implementation of a Decoder-Only Transformer (GPT-style) built using PyTorch, without relying on high-level abstractions. This implementation includes all core components: token embeddings, positional embeddings, multi-head self-attention, feedforward networks, causal masking, and output logits generation.