microsoft/autogen
Enable Next-Gen Large Language Model Applications. Join our Discord: https://discord.gg/pAbnFJrkgZ
Language: Jupyter Notebook
Total stars: 426
Stars trend:
27 Sep 2023
#jupyternotebook
#agentbasedframework, #agentorientedprogramming, #chat, #chatapplication, #chatbot, #chatgpt, #gpt, #gpt35turbo, #gpt4, #llmagent, #llmframework, #llminference, #llmops
Enable Next-Gen Large Language Model Applications. Join our Discord: https://discord.gg/pAbnFJrkgZ
Language: Jupyter Notebook
Total stars: 426
Stars trend:
27 Sep 2023
6am ██▏ +17
7am ███ +24
8am ██ +16
9am ██▊ +22
10am █▍ +11
11am ██▌ +20
12pm ███▎ +26
1pm █▌ +12
2pm █▌ +12
3pm ██ +16
4pm █▎ +10
5pm ██▏ +17
#jupyternotebook
#agentbasedframework, #agentorientedprogramming, #chat, #chatapplication, #chatbot, #chatgpt, #gpt, #gpt35turbo, #gpt4, #llmagent, #llmframework, #llminference, #llmops
SJTU-IPADS/PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
Language:C
Total stars: 259
Stars trend:
#c
#falcon, #largelanguagemodels, #llama, #llm, #llminference, #localinference
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
Language:C
Total stars: 259
Stars trend:
19 Dec 2023
10am █ +8
11am ▏ +1
12pm ▎ +2
1pm ▊ +6
2pm ██▌ +20
3pm █ +8
4pm █▋ +13
5pm █▎ +10
6pm ███▏ +25
7pm █▊ +14
8pm ██▋ +21
9pm ████▉ +39#c
#falcon, #largelanguagemodels, #llama, #llm, #llminference, #localinference
hpcaitech/SwiftInfer
Efficient AI Inference & Serving
Language:Python
Total stars: 162
Stars trend:
#python
#artificialintelligence, #deeplearning, #gpt, #inference, #llama, #llama2, #llminference, #llmserving
Efficient AI Inference & Serving
Language:Python
Total stars: 162
Stars trend:
8 Jan 2024
1am ▎ +2
2am ▌ +4
3am ███ +24
4am ██▌ +20
5am ████▌ +36
6am ███ +24
7am ██▍ +19
8am ██▉ +23#python
#artificialintelligence, #deeplearning, #gpt, #inference, #llama, #llama2, #llminference, #llmserving
liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验。
Language:Python
Total stars: 3518
Stars trend:
#python
#llm, #llminference, #llmserving, #llmtraining, #llmops
本项目旨在分享大模型相关技术原理以及实战经验。
Language:Python
Total stars: 3518
Stars trend:
2 Mar 2024
1am ▏ +1
2am +0
3am ▎ +2
4am ▏ +1
5am ▌ +4
6am █▉ +15
7am █▋ +13
8am ▍ +3
9am █▋ +13#python
#llm, #llminference, #llmserving, #llmtraining, #llmops
PreternaturalAI/mlx-swift-chat
A multi-platform SwiftUI app to test out LLMs with mlx-swift.
Language:Swift
Total stars: 68
Stars trend:
#swift
#ios, #llminference, #macos, #mlx, #mlxswift, #swiftui
A multi-platform SwiftUI app to test out LLMs with mlx-swift.
Language:Swift
Total stars: 68
Stars trend:
3 Mar 2024
7am █ +8
8am █▌ +12
9am █▏ +9
10am ▏ +1
11am ▌ +4
12pm ▎ +2
1pm ▉ +7
2pm ██ +16#swift
#ios, #llminference, #macos, #mlx, #mlxswift, #swiftui
microsoft/aici
AICI: Prompts as (Wasm) Programs
Language:Rust
Total stars: 213
Stars trend:
#rust
#ai, #inference, #languagemodel, #llm, #llmframework, #llminference, #llmserving, #llmops, #modelserving, #rust, #transformer, #wasm, #wasmtime
AICI: Prompts as (Wasm) Programs
Language:Rust
Total stars: 213
Stars trend:
11 Mar 2024
6pm ██▏ +17
7pm ███▎ +26
8pm ████▊ +38#rust
#ai, #inference, #languagemodel, #llm, #llmframework, #llminference, #llmserving, #llmops, #modelserving, #rust, #transformer, #wasm, #wasmtime
databricks/dbrx
Code examples and resources for DBRX, a large language model developed by Databricks
Language:Python
Total stars: 157
Stars trend:
#python
#databricks, #genai, #generativeai, #llm, #llminference, #llmtraining, #mosaicai
Code examples and resources for DBRX, a large language model developed by Databricks
Language:Python
Total stars: 157
Stars trend:
27 Mar 2024
11am ▋ +5
12pm █▌ +12
1pm ██▍ +19
2pm ███▊ +30
3pm ████▋ +37
4pm ████▎ +34#python
#databricks, #genai, #generativeai, #llm, #llminference, #llmtraining, #mosaicai
ghimiresunil/LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
Language:Jupyter Notebook
Total stars: 370
Stars trend:
#jupyternotebook
#bert, #huggingface, #largelanguagemodels, #llminference, #llmtraining, #llmtutorials, #opensource, #opensourcellm, #transformers
LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.
Language:Jupyter Notebook
Total stars: 370
Stars trend:
12 May 2024
2pm ▍ +3
3pm █▎ +10
4pm ███▋ +29
5pm ██▋ +21
6pm █▎ +10
7pm █▌ +12#jupyternotebook
#bert, #huggingface, #largelanguagemodels, #llminference, #llmtraining, #llmtutorials, #opensource, #opensourcellm, #transformers
beam-cloud/beta9
The open-source serverless GPU container runtime.
Language:Go
Total stars: 82
Stars trend:
#go
#cuda, #distributedcomputing, #finetuning, #generativeai, #gpu, #largelanguagemodels, #llm, #llminference, #mlplatform, #selfhosted
The open-source serverless GPU container runtime.
Language:Go
Total stars: 82
Stars trend:
13 May 2024
5pm █▎ +10
6pm ███▎ +26
7pm ██▋ +21
8pm ▉ +7
9pm ▊ +6
10pm █▍ +11#go
#cuda, #distributedcomputing, #finetuning, #generativeai, #gpu, #largelanguagemodels, #llm, #llminference, #mlplatform, #selfhosted
codelion/optillm
Optimizing inference proxy for LLMs
Language:Python
Total stars: 512
Stars trend:
#python
#agent, #agenticai, #agenticframework, #agenticworkflow, #agents, #apigateway, #genai, #largelanguagemodels, #llm, #llminference, #llmapi, #mixtureofexperts, #moa, #openai, #openaiapi, #optimization, #proxyserver
Optimizing inference proxy for LLMs
Language:Python
Total stars: 512
Stars trend:
17 Sep 2024
4am ▊ +6
5am ▎ +2
6am ▊ +6
7am █▏ +9
8am ▋ +5
9am ▎ +2
10am ▉ +7
11am ▊ +6
12pm ▏ +1
1pm ▋ +5
2pm █▌ +12
3pm ██ +16#python
#agent, #agenticai, #agenticframework, #agenticworkflow, #agents, #apigateway, #genai, #largelanguagemodels, #llm, #llminference, #llmapi, #mixtureofexperts, #moa, #openai, #openaiapi, #optimization, #proxyserver
PySpur-Dev/PySpur
Graph-Based Editor for LLM Workflows
Language:Python
Total stars: 263
Stars trend:
#python
#agent, #ai, #javascript, #llm, #llminference, #openai, #python, #react, #workflow, #ycombinator
Graph-Based Editor for LLM Workflows
Language:Python
Total stars: 263
Stars trend:
17 Dec 2024
11pm ▌ +4
18 Dec 2024
12am ▍ +3
1am ▎ +2
2am +0
3am ▌ +4
4am █ +8
5am █▎ +10
6am ▉ +7
7am █▋ +13
8am ▊ +6
9am █▌ +12
10am █▎ +10#python
#agent, #ai, #javascript, #llm, #llminference, #openai, #python, #react, #workflow, #ycombinator
FellouAI/eko
Eko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai
Language:TypeScript
Total stars: 305
Stars trend:
#typescript
#agent, #agenticai, #agenticaidevelopment, #agenticframework, #agenticworkflow, #agents, #aiagents, #browserautomation, #browseruse, #chainofthought, #computerautomation, #computeruse, #genai, #llmagents, #llminference, #llmapi, #naturallanguageinference, #promptengineering, #rag, #workflow
Eko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai
Language:TypeScript
Total stars: 305
Stars trend:
14 Jan 2025
5pm ▏ +1
6pm ▏ +1
7pm ▏ +1
8pm +0
9pm ▏ +1
10pm ▍ +3
11pm ▍ +3
15 Jan 2025
12am █▎ +10
1am ██▌ +20
2am ██ +16
3am █▍ +11
4am █▏ +9#typescript
#agent, #agenticai, #agenticaidevelopment, #agenticframework, #agenticworkflow, #agents, #aiagents, #browserautomation, #browseruse, #chainofthought, #computerautomation, #computeruse, #genai, #llmagents, #llminference, #llmapi, #naturallanguageinference, #promptengineering, #rag, #workflow
sauravpanda/BrowserAI
Run local LLMs inside your browser
Language:TypeScript
Total stars: 196
Stars trend:
#typescript
#agents, #ai, #llm, #llminference, #localllm, #tts, #webgpu
Run local LLMs inside your browser
Language:TypeScript
Total stars: 196
Stars trend:
22 Jan 2025
3pm ▏ +1
4pm +0
5pm █ +8
6pm ████▎ +34
7pm ▊ +6
8pm ▉ +7
9pm ▎ +2
10pm ▌ +4
11pm ▊ +6
23 Jan 2025
12am ▌ +4
1am ▍ +3#typescript
#agents, #ai, #llm, #llminference, #localllm, #tts, #webgpu
b4rtaz/distributed-llama
Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Language:C++
Total stars: 1786
Stars trend:
#cplusplus
#distributedcomputing, #distributedllm, #llama2, #llama3, #llm, #llminference, #llms, #neuralnetwork, #openllm
Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
Language:C++
Total stars: 1786
Stars trend:
15 Feb 2025
3pm ▏ +1
4pm █▋ +13
5pm █▊ +14
6pm ██▎ +18
7pm █▎ +10
8pm ▌ +4
9pm ▊ +6
10pm ▋ +5
11pm ▍ +3
16 Feb 2025
12am ▏ +1
1am +0
2am ▏ +1#cplusplus
#distributedcomputing, #distributedllm, #llama2, #llama3, #llm, #llminference, #llms, #neuralnetwork, #openllm
Lizonghang/prima.cpp
prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters
Language:C++
Total stars: 101
Stars trend:
#cplusplus
#distributedai, #llamacpp, #llminference, #ondevicellms
prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters
Language:C++
Total stars: 101
Stars trend:
15 Apr 2025
2am ██ +16
3am ██▋ +21
4am █ +8
5am ▌ +4
6am █ +8
7am ▌ +4
8am ▍ +3
9am ▍ +3
10am ▏ +1
11am ▋ +5
12pm ▋ +5#cplusplus
#distributedai, #llamacpp, #llminference, #ondevicellms
stanford-mast/blast
Browser-LLM Auto-Scaling Technology
Language:Python
Total stars: 198
Stars trend:
#python
#aiagents, #browserautomation, #llminference, #python
Browser-LLM Auto-Scaling Technology
Language:Python
Total stars: 198
Stars trend:
2 May 2025
5pm █ +8
6pm ████▊ +38
7pm ████▋ +37
8pm ████▏ +33
9pm ██▊ +22#python
#aiagents, #browserautomation, #llminference, #python
codelion/openevolve
Open-source implementation of AlphaEvolve
Language:Python
Total stars: 570
Stars trend:
#python
#alphaevolve, #alphacode, #alphaevolve, #codingagent, #deepmind, #deepmindlab, #discovery, #distributedevolutionaryalgorithms, #evolutionaryalgorithms, #evolutionarycomputation, #geneticalgorithm, #geneticalgorithms, #iterativemethods, #iterativerefinement, #llmengineering, #llmensemble, #llminference, #openevolve, #optimize
Open-source implementation of AlphaEvolve
Language:Python
Total stars: 570
Stars trend:
22 May 2025
1am ▋ +5
2am ▌ +4
3am ▋ +5
4am +0
5am ▉ +7
6am ▎ +2
7am ▋ +5
8am ▍ +3
9am █ +8
10am ██ +16
11am ███▎ +26
12pm ████▍ +35#python
#alphaevolve, #alphacode, #alphaevolve, #codingagent, #deepmind, #deepmindlab, #discovery, #distributedevolutionaryalgorithms, #evolutionaryalgorithms, #evolutionarycomputation, #geneticalgorithm, #geneticalgorithms, #iterativemethods, #iterativerefinement, #llmengineering, #llmensemble, #llminference, #openevolve, #optimize
gitleaks/gitleaks
Find secrets with Gitleaks 🔑
Language:Go
Total stars: 20816
Stars trend:
#go
#aipowered, #cicd, #cicd, #cli, #datalossprevention, #devsecops, #dlp, #git, #gitleaks, #go, #golang, #hacktoberfest, #llm, #llminference, #llmtraining, #opensource, #secret, #security, #securitytools
Find secrets with Gitleaks 🔑
Language:Go
Total stars: 20816
Stars trend:
26 Jun 2025
12pm ▉ +7
1pm ▌ +4
2pm ▌ +4
3pm ▋ +5
4pm ▉ +7
5pm ▋ +5
6pm █▌ +12
7pm ▍ +3
8pm █▋ +13
9pm ▌ +4
10pm ▉ +7
11pm ▉ +7#go
#aipowered, #cicd, #cicd, #cli, #datalossprevention, #devsecops, #dlp, #git, #gitleaks, #go, #golang, #hacktoberfest, #llm, #llminference, #llmtraining, #opensource, #secret, #security, #securitytools