b4rtaz/distributed-llama
Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Language:C++
Total stars: 1786
Stars trend:
#cplusplus
#distributedcomputing, #distributedllm, #llama2, #llama3, #llm, #llminference, #llms, #neuralnetwork, #openllm
Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Language:C++
Total stars: 1786
Stars trend:
15 Feb 2025
3pm ▏ +1
4pm █▋ +13
5pm █▊ +14
6pm ██▎ +18
7pm █▎ +10
8pm ▌ +4
9pm ▊ +6
10pm ▋ +5
11pm ▍ +3
16 Feb 2025
12am ▏ +1
1am +0
2am ▏ +1#cplusplus
#distributedcomputing, #distributedllm, #llama2, #llama3, #llm, #llminference, #llms, #neuralnetwork, #openllm
Lizonghang/prima.cpp
prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters
Language:C++
Total stars: 101
Stars trend:
#cplusplus
#distributedai, #llamacpp, #llminference, #ondevicellms
prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters
Language:C++
Total stars: 101
Stars trend:
15 Apr 2025
2am ██ +16
3am ██▋ +21
4am █ +8
5am ▌ +4
6am █ +8
7am ▌ +4
8am ▍ +3
9am ▍ +3
10am ▏ +1
11am ▋ +5
12pm ▋ +5#cplusplus
#distributedai, #llamacpp, #llminference, #ondevicellms
stanford-mast/blast
Browser-LLM Auto-Scaling Technology
Language:Python
Total stars: 198
Stars trend:
#python
#aiagents, #browserautomation, #llminference, #python
Browser-LLM Auto-Scaling Technology
Language:Python
Total stars: 198
Stars trend:
2 May 2025
5pm █ +8
6pm ████▊ +38
7pm ████▋ +37
8pm ████▏ +33
9pm ██▊ +22#python
#aiagents, #browserautomation, #llminference, #python
codelion/openevolve
Open-source implementation of AlphaEvolve
Language:Python
Total stars: 570
Stars trend:
#python
#alphaevolve, #alphacode, #alphaevolve, #codingagent, #deepmind, #deepmindlab, #discovery, #distributedevolutionaryalgorithms, #evolutionaryalgorithms, #evolutionarycomputation, #geneticalgorithm, #geneticalgorithms, #iterativemethods, #iterativerefinement, #llmengineering, #llmensemble, #llminference, #openevolve, #optimize
Open-source implementation of AlphaEvolve
Language:Python
Total stars: 570
Stars trend:
22 May 2025
1am ▋ +5
2am ▌ +4
3am ▋ +5
4am +0
5am ▉ +7
6am ▎ +2
7am ▋ +5
8am ▍ +3
9am █ +8
10am ██ +16
11am ███▎ +26
12pm ████▍ +35#python
#alphaevolve, #alphacode, #alphaevolve, #codingagent, #deepmind, #deepmindlab, #discovery, #distributedevolutionaryalgorithms, #evolutionaryalgorithms, #evolutionarycomputation, #geneticalgorithm, #geneticalgorithms, #iterativemethods, #iterativerefinement, #llmengineering, #llmensemble, #llminference, #openevolve, #optimize
gitleaks/gitleaks
Find secrets with Gitleaks 🔑
Language:Go
Total stars: 20816
Stars trend:
#go
#aipowered, #cicd, #cicd, #cli, #datalossprevention, #devsecops, #dlp, #git, #gitleaks, #go, #golang, #hacktoberfest, #llm, #llminference, #llmtraining, #opensource, #secret, #security, #securitytools
Find secrets with Gitleaks 🔑
Language:Go
Total stars: 20816
Stars trend:
26 Jun 2025
12pm ▉ +7
1pm ▌ +4
2pm ▌ +4
3pm ▋ +5
4pm ▉ +7
5pm ▋ +5
6pm █▌ +12
7pm ▍ +3
8pm █▋ +13
9pm ▌ +4
10pm ▉ +7
11pm ▉ +7#go
#aipowered, #cicd, #cicd, #cli, #datalossprevention, #devsecops, #dlp, #git, #gitleaks, #go, #golang, #hacktoberfest, #llm, #llminference, #llmtraining, #opensource, #secret, #security, #securitytools
cactus-compute/cactus
Cross-platform framework for deploying LLM/VLM/TTS models locally on smartphones.
Language:C++
Total stars: 1481
Stars trend:
#cplusplus
#ai, #android, #dart, #edge, #flutter, #framework, #ios, #javascript, #kotlin, #library, #llamacpp, #llm, #llminference, #llms, #mobile, #reactnative, #smartphone, #swift, #transformer, #typescript
Cross-platform framework for deploying LLM/VLM/TTS models locally on smartphones.
Language:C++
Total stars: 1481
Stars trend:
10 Jul 2025
11am ▎ +2
12pm ▋ +5
1pm ▎ +2
2pm ▏ +1
3pm ▏ +1
4pm ▎ +2
5pm ▍ +3
6pm ▊ +6
7pm ▊ +6
8pm █▎ +10
9pm ███▎ +26
10pm ██▉ +23#cplusplus
#ai, #android, #dart, #edge, #flutter, #framework, #ios, #javascript, #kotlin, #library, #llamacpp, #llm, #llminference, #llms, #mobile, #reactnative, #smartphone, #swift, #transformer, #typescript
nomic-ai/gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Language:C++
Total stars: 74285
Stars trend:
#cplusplus
#aichat, #llminference
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Language:C++
Total stars: 74285
Stars trend:
10 Aug 2025
2pm █ +8
3pm ▊ +6
4pm ▉ +7
5pm ▌ +4
6pm ▍ +3
7pm ▌ +4
8pm ▊ +6
9pm ▋ +5
10pm ▉ +7
11pm ▋ +5
11 Aug 2025
12am ▊ +6
1am ██ +16#cplusplus
#aichat, #llminference
❤2