pretrain

Open repos and models their makers tagged pretrain, most starred first. The same for everyone.

AI on my own machineRepo

GrandLine_LLM

从零构建类 Qwen 3 Dense架构 / Deepseek MoE架构大语言模型,全链路打通“预训练、SFT、CoT蒸馏、GRPO 对齐与评测闭环”的端到端大模型训练管线。

  • 5
  • Python
  • MIT
  • 12 d ago
Justin-ljwTake it
Search GitHub and Hugging Face for pretrain

Get , open it once and sign in. Then come back here and press the button again.