b4rtaz/distributed-llama
Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Language:C++
Total stars: 1786
Stars trend:
15 Feb 2025
3pm ▏ +1
4pm █▋ +13
5pm █▊ +14
6pm ██▎ +18
7pm █▎ +10
8pm ▌ +4
9pm ▊ +6
10pm ▋ +5
11pm ▍ +3
16 Feb 2025
12am ▏ +1
1am +0
2am ▏ +1
#cplusplus
#distributedcomputing, #distributedllm, #llama2, #llama3, #llm, #llminference, #llms, #neuralnetwork, #openllm