sail-sg/Adan
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
Language: Python
#adan #bert_model #convnext #deep_learning #fairseq #mae #optimizer #resnet #timm #transformer_xl #vit
Stars: 158 Issues: 2 Forks: 5
https://github.com/sail-sg/Adan

extreme-bert/extreme-bert
ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.
Language: Python
#bert #deep_learning #language_model #language_models #machine_learning #natural_language_processing #nlp #python #pytorch #transformer
Stars: 135 Issues: 0 Forks: 5
https://github.com/extreme-bert/extreme-bert

vllm-project/semantic-router
Intelligent Mixture-of-Models Router for Efficient LLM Inference
Language: Python
#bert_classification #golang #huggingface_candle #huggingface_transformers #mixture_of_models #pii_detection #prompt_guard #python #rust #semantic_router #vllm
Stars: 238 Issues: 1 Forks: 19
https://github.com/vllm-project/semantic-router