SJTU-IPADS/PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
Language:C
Total stars: 259
Stars trend:
19 Dec 2023
10am █ +8
11am ▏ +1
12pm ▎ +2
1pm ▊ +6
2pm ██▌ +20
3pm █ +8
4pm █▋ +13
5pm █▎ +10
6pm ███▏ +25
7pm █▊ +14
8pm ██▋ +21
9pm ████▉ +39
#c
#falcon, #largelanguagemodels, #llama, #llm, #llminference, #localinference