LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
- 109k
- Jupyter Notebook
- 22 h ago
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
all kinds of text classification models and more with deep learning
A concise but complete full-attention transformer with a set of promising experimental features from various papers
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
A collection of important graph embedding, classification and representation learning papers with implementations.
RuVector provides High Performance, Real-Time decisions and agent memory , Self-Learning Ai, Vector GNN DB built in Rust.
A TensorFlow Implementation of the Transformer: Attention Is All You Need
Build a modern LLM from scratch. Every line commented. Explained like we are five.
Automatic Speech Recognition (ASR), Speaker Verification, Speech Synthesis, Text-to-Speech (TTS), Language Modelling, Singing Voice Synthesis (SVS), Voice Conversion (VC)
| Name | Stars | License | Language | Last change | In common | Compare |
|---|---|---|---|---|---|---|
| HiLab-git/CA-Net | 176 | None declared | Python | 6 y ago | ||
| rasbt/LLMs-from-scratch | 109k | None declared | Jupyter Notebook | 22 h ago | attention-mechanism | Compare |
| lucidrains/vit-pytorch | 26k | MIT | Python | 2 wk ago | attention-mechanism | Compare |
| nndl/nndl | 20k | None declared | Unknown | 3 mo ago | attention-mechanism | Compare |
| BlinkDL/RWKV-LM | 15k | Apache-2.0 | Python | 3 wk ago | attention-mechanism | Compare |
| brightmart/text_classification | 7.9k | MIT | Python | 3 y ago | attention-mechanism | Compare |
| lucidrains/x-transformers | 6k | MIT | Python | 4 d ago | attention-mechanism | Compare |
| lucidrains/DALLE-pytorch | 5.6k | MIT | Python | 3 y ago | attention-mechanism | Compare |
| benedekrozemberczki/awesome-graph-classification | 4.8k | CC0-1.0 | Python | 4 y ago | attention-mechanism | Compare |
| ruvnet/RuVector | 4.7k | MIT | Rust | 7 h ago | attention-mechanism | Compare |
| Kyubyong/transformer | 4.5k | Apache-2.0 | Python | 4 y ago | attention-mechanism | Compare |
| raiyanyahya/how-to-train-your-gpt | 4.2k | MIT | Jupyter Notebook | 4 wk ago | attention-mechanism | Compare |
| zzw922cn/awesome-speech-recognition-speech-synthesis-papers | 3.1k | MIT | Unknown | 3 y ago | attention-mechanism | Compare |