yanring
training system @ periodic | ex MCore MoE Lead
Built from yanring's public GitHub profile. Not on Take My Repo yet, so there are no posts or updates here.
Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.
Research on The Impact of Road Traffic Around on Opening Residential Community Based on Cellular Automaton
Dual-way gradient sparsification approach for async DNN training, based on PyTorch.
Fork the Megatron Lite branch (https://github.com/ISEEKYAN/Megatron-LM/tree/lite)