decoder-only-transformer

Open repos and models their makers tagged decoder-only-transformer, most starred first. The same for everyone.

GitHubRepo

Decoder-Only-Transformer-Architecture-Implementation-in-Pytorch

A complete implementation of a Decoder-Only Transformer (GPT-style) built using PyTorch, without relying on high-level abstractions. This implementation includes all core components: token embeddings, positional embeddings, multi-head self-attention, feedforward networks, causal masking, and output logits generation.

  • 4
  • Python
  • MIT
  • 9 mo ago
shaheennabiTake it
Search GitHub and Hugging Face for decoder-only-transformer

Get , open it once and sign in. Then come back here and press the button again.