bentoml/llm-inference-in-production
Everything you need to know about LLM inference
Language: TypeScript
#llm #llm_inference
Stars: 154 Issues: 3 Forks: 8
https://github.com/bentoml/llm-inference-in-production

scottvr/wtffmpeg
a toy that has a local llm spit out ffmpeg commands from natural language prompts on the command-line
Language: Python
#ffmpeg #llm
Stars: 250 Issues: 0 Forks: 4
https://github.com/scottvr/wtffmpeg

NU-QRG/optiml
Acceleration library for LLM agents.
Language: C++
#llama #llm
Stars: 198 Issues: 7 Forks: 44
https://github.com/NU-QRG/optiml

office-sec/AionUi
Free, local, open-source GUI app for Gemini CLI — Enhance Chat Experience, Multi-tasking, Code Diff View, File & Project Management, and more | 🌟 Star if you like it!
Language: TypeScript
#ai #ai_agent #gemini #gemini_ai #gemini_cli #gemini_pro #gui #gui_application #ide #llm #llm_code #multi_agent #nodejs #react #typescript
Stars: 375 Issues: 2 Forks: 30
https://github.com/office-sec/AionUi

instructa/browser-echo
⚡ Stream browser logs to terminal, zero setup, perfect for Ai Agents
Language: TypeScript
#ai #browser #claude_code #codex_cli #cursor #gemini_cli #llm #log #logging
Stars: 193 Issues: 2 Forks: 7
https://github.com/instructa/browser-echo

Chen-zexi/vllm-cli
A command-line interface tool for serving LLM using vLLM.
Language: Python
#llm #llm_tools #vllm
Stars: 243 Issues: 1 Forks: 5
https://github.com/Chen-zexi/vllm-cli

vakovalskii/sgr-deep-research
Schema-Guided Reasoning (SGR) is a technique that guides large language models (LLMs) to produce structured, clear, and predictable outputs by enforcing reasoning through predefined steps. By creating a specific schema (or structured template), you explicitly define:
Language: Python
#agent #llm #sgr #so #structured_output
Stars: 173 Issues: 0 Forks: 35
https://github.com/vakovalskii/sgr-deep-research

yassa9/qwen600
Static suckless single batch CUDA-only qwen3-0.6B mini inference engine
Language: Cuda
#cuda #cuda_programming #gpu #llamacpp #llm #llm_inference #qwen #qwen3 #transformer
Stars: 287 Issues: 1 Forks: 17
https://github.com/yassa9/qwen600

oxbshw/LLM-Agents-Ecosystem-Handbook
One-stop handbook for building, deploying, and understanding LLM agents with 60+ skeletons, tutorials, ecosystem guides, and evaluation tools.
Language: Python
#ai #ai_agent #ai_agents #fine_tuning #finetuning_llms #freamework #llm #llmops #local_development #mcp_server #memory #rag #rag_chatbot #voice_agent
Stars: 198 Issues: 0 Forks: 29
https://github.com/oxbshw/LLM-Agents-Ecosystem-Handbook

WooooDyy/AgentGym-RL
Code and implementations for the paper "AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learning" by Zhiheng Xi et al.
Language: Python
#agent #llm #llm_based_agent #scaling
Stars: 255 Issues: 4 Forks: 21
https://github.com/WooooDyy/AgentGym-RL

pguso/ai-agents-from-scratch
Demystify AI agents by building them yourself. Local LLMs, no black boxes, real understanding of function calling, memory, and ReAct patterns.
Language: JavaScript
#ai_agents #educational #function_calling #llm #llm_agent #node_llama_cpp #react_agent #tutorial
Stars: 342 Issues: 7 Forks: 22
https://github.com/pguso/ai-agents-from-scratch