terngrad
Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)
- 181
- Python
- Apache-2.0
- 8 y ago
Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)
Keras/TF implementation of AdamW, SGDW, NadamW, Warm Restarts, and Learning Rate multipliers
A C++ toolkit for Convex Optimization (Logistic Loss, SVM, SVR, Least Squares etc.), Convex Optimization algorithms (LBFGS, TRON, SGD, AdsGrad, CG, Nesterov etc.) and Classifiers/Regressors (Logistic Regression, SVMs, Least Squares Regression etc.)
Image text to text model, used with transformers.