learning-rate-scheduling
pytorch_optimizer
optimizer & lr scheduler & loss function collections in PyTorch
- 436
- Python
- Apache-2.0
- 2 d ago
Pytorch-DistributedDataParallel-Training-Tricks
A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.
- 65
- Python
- MIT
- 5 y ago
lr-momentum-scheduler
Pytorch implementation of arbitrary learning rate and momentum schedules, including the One Cycle Policy
- 12
- Python
- MIT
- 6 y ago


