dpo

Open repos and models their makers tagged dpo, most starred first. The same for everyone.

AI on my own machineRepo

MedicalGPT

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型,实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。

  • 5.9k
  • Python
  • Apache-2.0
  • 2 mo ago
shibing624Take it
AI on my own machineRepo

DeepMesh

[ICCV 2025] Official code of DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learning

  • 739
  • Python
  • Apache-2.0
  • 11 mo ago
zhaorw02Take it
AI agentsRepo

unsloth-buddy

Zero-friction LLM fine-tuning skill for Claude Code, Gemini CLI & any ACP agent. Unsloth on NVIDIA · TRL+MPS/MLX on Apple Silicon. Automates env setup, LoRA training (SFT, DPO, GRPO, vision), post-hoc GRPO log diagnostics, evaluation, and export end-to-end. Part of the Gaslamp AI platform.

  • 282
  • Python
  • MIT
  • 5 mo ago
TYH-labsTake it
AI on my own machineRepo

minimind-deep-dive

从 MiniMind 源码读起,再延伸到现代大模型技术体系的中文学习笔记。主线逐行精读预训练 / SFT / DPO / PPO / GRPO 与训练机制;附录 17 篇进阶卷覆盖量化、投机解码、RLHF 全景、模型代际史等 MiniMind 没涉及、但进阶绕不开的主题。

  • 223
  • Python
  • CC-BY-4.0
  • 5 wk ago
Enping-HuTake it
AI on my own machineRepo

hands-on-llm

动手学大模型全栈:CS336 中文精讲 · PyTorch 手搓 Transformer · 单卡复现 Pretrain/SFT/LoRA/DPO/GRPO/RLVR · PEFT/Agent/RAG 落地(含真实实验、曲线与复现脚本)

  • 126
  • Python
  • MIT
  • 2 mo ago
FRS2003Take it
Images and videoRepo

CHATS

CHATS: Combining Human-Aligned Optimization and Test-Time Sampling for Text-to-Image Generation (ICML2025)

  • 106
  • Python
  • Apache-2.0
  • 15 mo ago
ATH-MaaSTake it
AI on my own machineRepo

Chinese-MedQA-Qwen2

基于Qwen2+SFT+DPO的医疗问答系统,项目中使用了自定义的 SFTTrainer/DPOTrainer/TRPOTrainer用于训练,其次,项目还调用各种知识库工具(neo4j, milvus, LDA, 等)进行自动化训练数据生成。另外,使用 vllm 用于推理和部署训好的模型, 该模型会通过 vllm API 来接入一个基于 embedder + Reranker 的 RAG 系统。另外还参考 MDAgents 论文实现了一个多智能体会诊系统,同样也支持 vllm api 接入。

  • 90
  • Python
  • 7 mo ago
NJUxljTake it
AI agentsRepo

Travel-Agent-based-on-Qwen2-RLHF

A travel agent based on Qwen2.5, fine-tuned by SFT + DPO/PPO/GRPO using traveling question-answer dataset, a mindmap can be output using the response. A RAG system is build upon the tuned qwen2, using Prompt-Template + Tool-Use + Chroma embedding database + LangChain

  • 83
  • Python
  • 5 mo ago
NJUxljTake it
AI on my own machineRepo

oreilly-llm-rl-alignment

This training offers an intensive exploration into the frontier of reinforcement learning techniques with large language models (LLMs). We will explore advanced topics such as Reinforcement Learning with Human Feedback (RLHF), Reinforcement Learning from AI Feedback (RLAIF), Reasoning LLMs, and demonstrate practical applications such as fine-tuning

  • 71
  • Jupyter Notebook
  • 9 mo ago
AI on my own machineRepo

minllm

A minimal LLM pipeline that runs on a laptop, written from scratch in PyTorch and to be read: tokenizer, pretraining, inference, fine-tuning, RLHF and RLVR, with measured results and an interactive website.

  • 6
  • JavaScript
  • MIT
  • 5 wk ago
changkunTake it
AI on my own machineRepo

trainall

One library for the frontier LLM training stack — pre-training, CPT/DAPT, SFT, DPO/IPO/KTO/ORPO/SimPO/CPO, RLHF, RLVR+GRPO, agentic RL, distillation & self-play, LoRA/QLoRA — behind one config-driven, registry-based API. import trainall is torch-free.

  • 2
  • Python
  • MIT
  • 5 mo ago
Search GitHub and Hugging Face for dpo

Get , open it once and sign in. Then come back here and press the button again.

dpo: open source repos and models on Take My Repo