janhq/nitro
A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API
Language:C++
Total stars: 362
Stars trend:
#cplusplus
#accelerated, #ai, #cuda, #gguf, #inferenceengine, #llama, #llama2, #llamacpp, #llm, #llms, #openaiapi, #stablediffusion, #tensorrtllm
A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API
Language:C++
Total stars: 362
Stars trend:
6 Jan 2024
1am ▏ +1
2am ██▉ +23
3am █████▎ +42
4am ████▍ +35
5am █▍ +11
6am █▋ +13
7am ▌ +4
8am ▍ +3
9am █▎ +10
10am ▏ +1
11am ▌ +4
12pm ▊ +6#cplusplus
#accelerated, #ai, #cuda, #gguf, #inferenceengine, #llama, #llama2, #llamacpp, #llm, #llms, #openaiapi, #stablediffusion, #tensorrtllm
hpcaitech/SwiftInfer
Efficient AI Inference & Serving
Language:Python
Total stars: 162
Stars trend:
#python
#artificialintelligence, #deeplearning, #gpt, #inference, #llama, #llama2, #llminference, #llmserving
Efficient AI Inference & Serving
Language:Python
Total stars: 162
Stars trend:
8 Jan 2024
1am ▎ +2
2am ▌ +4
3am ███ +24
4am ██▌ +20
5am ████▌ +36
6am ███ +24
7am ██▍ +19
8am ██▉ +23#python
#artificialintelligence, #deeplearning, #gpt, #inference, #llama, #llama2, #llminference, #llmserving