rope

Open repos and models their makers tagged rope, most starred first. The same for everyone.

AI on my own machineRepo

minimind-deep-dive

从 MiniMind 源码读起,再延伸到现代大模型技术体系的中文学习笔记。主线逐行精读预训练 / SFT / DPO / PPO / GRPO 与训练机制;附录 17 篇进阶卷覆盖量化、投机解码、RLHF 全景、模型代际史等 MiniMind 没涉及、但进阶绕不开的主题。

  • 223
  • Python
  • CC-BY-4.0
  • 4 wk ago
Enping-HuTake it
AI on my own machineRepo

LLaMA2

This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT) variant. The implementation focuses on the model architecture and the inference process. The code is restructured and heavily commented to facilitate easy understanding of the key parts of the architecture.

  • 73
  • Python
  • 3 y ago
aju22Take it
Language and translationRepo

H64LM

249M-param MoE transformer built from scratch in PyTorch. GQA, RoPE, SwiGLU, sparse MoE with 3 aux losses, AMP training loop no Trainer abstractions. Architecture mirrors LLaMA/Mistral/Mixtral decisions, fully inspectable.

  • 19
  • Jupyter Notebook
  • Apache-2.0
  • 6 mo ago
Haiderkhan64Take it
AI on my own machineRepo

Marcella-66M-SLM

A 66M parameter decoder-only transformer language model implemented from scratch in PyTorch. Features a custom SentencePiece tokenizer, RoPE positional embeddings, SwiGLU feed-forward network, per-layer KV cache for efficient autoregressive inference, and a Svelte-based streaming chat interface.

  • 2
  • Python
  • MIT
  • 6 mo ago
aidendorianTake it
Search GitHub and Hugging Face for rope

Get , open it once and sign in. Then come back here and press the button again.

rope: open source repos and models on Take My Repo