llm-training
ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
- 12k
- Python
- Apache-2.0
- 2 d ago
skypilot
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
- 11k
- Python
- Apache-2.0
- 2 d ago
ai-infra-book
《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
- 8.2k
- Python
- Apache-2.0
- 7 wk ago
h2o-llmstudio
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
- 5.2k
- Python
- Apache-2.0
- 3 d ago
openlake
OpenLake is a high performance storage engine for efficient LLM inference and GPU Training
- 3.1k
- Rust
- Apache-2.0
- 2 d ago
GraphGen
GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation
- 1.2k
- Python
- Apache-2.0
- 2 wk ago
veScale
Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs
- 1.1k
- Python
- Apache-2.0
- 11 d ago
AI-Compass
“AI-Compass”将为社区指引在 AI 技术海洋中航行的方向,无论你是初学者还是进阶开发者,都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势,并通过实践掌握从理论到落地的全过程。
- 1k
- Python
- 2 d ago
Adan
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
- 826
- Python
- Apache-2.0
- 18 mo ago
awesome-on-policy-distillation
A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models
- 926
- CC0-1.0
- 7 wk ago
llm-algo-leetcode
Hands-on LLM algorithms and systems with PyTorch, Triton & CUDA.《大模型算法与系统教程》:模型架构与训练、后训练、推理加速、性能与算子优化,配套 Notebook 练习、答案解析、测试与实验。
- 808
- Jupyter Notebook
- 5 d ago
long-context-attention
USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
- 697
- Python
- Apache-2.0
- 2 mo ago
LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
- 734
- Jupyter Notebook
- MIT
- 8 mo ago
ICLR2025-Papers-with-Code
历年ICLR论文和开源项目合集,包含ICLR2021、ICLR2022、ICLR2023、ICLR2024、ICLR2025.
- 591
- 21 mo ago
LLM-FineTuning-Large-Language-Models
LLM (Large Language Model) FineTuning
- 580
- Jupyter Notebook
- 20 mo ago
InternEvo
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
- 420
- Python
- Apache-2.0
- 15 mo ago
LightRFT
LightRFT: Light, Efficient, Omni-modal & Reward-model Driven Reinforcement Fine-Tuning Framework
- 381
- Python
- Apache-2.0
- 3 mo ago
pmetal
PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.
- 334
- Rust
- 3 wk ago
cevahir-ai
Cevahir Zihin: a mind that learns by living, not a Transformer. It keeps knowledge as evidence on ties, attends with a Seven-Place Focus and learns from every conversation. Also: a Turkish BPE tokenizer, a Transformer language-model core and cognitive systems.
- 313
- Python
- Apache-2.0
- 3 h ago
The ultimate guide to multi-harness RL
Train open models with RL inside real agent harnesses
Runs in the browser on Hugging Face
- 308
- 4 wk ago
MLX-LoRA-Studio
A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.
- 290
- Swift
- MIT
- 4 wk ago
modern-llm-notebook
A hands-on course on modern LLM architectures, training, and inference, with step-by-step PyTorch implementations and runnable notebooks.
- 290
- Jupyter Notebook
- 7 wk ago
The ultimate guide to RL environments: building and scaling them in the LLM era
Building and scaling RL environments for LLM training
Runs in the browser on Hugging Face
- 287
- 7 mo ago
LLMtuner
FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
- 251
- Python
- Apache-2.0
- 3 y ago
text2cypher
collection of text2cypher datasets, evaluations, and finetuning instructions
- 246
- Jupyter Notebook
- CC0-1.0
- 6 wk ago
minimind-deep-dive
从 MiniMind 源码读起,再延伸到现代大模型技术体系的中文学习笔记。主线逐行精读预训练 / SFT / DPO / PPO / GRPO 与训练机制;附录 17 篇进阶卷覆盖量化、投机解码、RLHF 全景、模型代际史等 MiniMind 没涉及、但进阶绕不开的主题。
- 223
- Python
- CC-BY-4.0
- 5 wk ago
Megatron-MoE-ModelZoo
Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.
- 206
- Python
- MIT
- 6 mo ago





















