microsoft/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Language: Python
Stars trend:
11 Apr 2023

 5pm ▎ 2

 6pm ▏ 1

 7pm ▎ 2

 8pm ▋ 5

 9pm █▋ 13

10pm ▌ 4

11pm █▊ 14

12 Apr 2023

12am █▊ 14

 1am ██▍ 19

 2am ██▊ 22

 3am ████▉ 39

 4am ██▌ 20

#python
#billionparameters, #compression, #dataparallelism, #deeplearning, #gpu, #inference, #machinelearning, #mixtureofexperts, #modelparallelism, #pipelineparallelism, #pytorch, #trillionparameters, #zero