dvmazur/mixtral-offloading
Run Mixtral-8x7B models in Colab or consumer desktops
Language:Python
Total stars: 521
Stars trend:
1 Jan 2024
6am ▍ +3
7am +0
8am ▎ +2
9am ▍ +3
10am +0
11am ▉ +7
12pm ███ +24
1pm ██▋ +21
2pm ███▏ +25
3pm ██▋ +21
4pm ███▍ +27
5pm ████ +32
#python
#colabnotebook, #deeplearning, #googlecolab, #languagemodel, #llm, #mixtureofexperts, #offloading, #pytorch, #quantization