didi/booster
✨Optimizer for mobile applications
Language: Kotlin
#android #bytecode_manipulation #gradle_plugin #ios #optimizer #static_analysis
Stars: 263 Issues: 1 Forks: 18
https://github.com/didi/booster

lucidrains/Adan-pytorch
Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch
Language: Python
#artificial_intelligence #deep_learning #optimizer
Stars: 110 Issues: 1 Forks: 3
https://github.com/lucidrains/Adan-pytorch

sail-sg/Adan
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
Language: Python
#adan #bert_model #convnext #deep_learning #fairseq #mae #optimizer #resnet #timm #transformer_xl #vit
Stars: 158 Issues: 2 Forks: 5
https://github.com/sail-sg/Adan

Liuhong99/Sophia
The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
Language: Python
#deep_learning #large_language_models #optimizer
Stars: 232 Issues: 2 Forks: 6
https://github.com/Liuhong99/Sophia

kyegomez/Sophia
Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
Language: Python
#artificial_intelligence #chatgpt #deep_learning #multi_modality #neural_network #optimizer
Stars: 229 Issues: 11 Forks: 16
https://github.com/kyegomez/Sophia