codelion/optillm
Optimizing inference proxy for LLMs
Language:Python
Total stars: 512
Stars trend:
17 Sep 2024
4am ▊ +6
5am ▎ +2
6am ▊ +6
7am █▏ +9
8am ▋ +5
9am ▎ +2
10am ▉ +7
11am ▊ +6
12pm ▏ +1
1pm ▋ +5
2pm █▌ +12
3pm ██ +16
#python
#agent, #agenticai, #agenticframework, #agenticworkflow, #agents, #apigateway, #genai, #largelanguagemodels, #llm, #llminference, #llmapi, #mixtureofexperts, #moa, #openai, #openaiapi, #optimization, #proxyserver