bojieli/ai-infra-book
《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Language:Python
Total stars: 2403
#python
#accelerator, #aiinfra, #aiinfrastructure, #book, #datacenternetwork, #deepseek, #distributedsystems, #gpu, #kvcache, #llm, #llminference, #llmserving, #llmtraining, #mixtureofexperts, #performanceengineering

TencentCloud/Octop
A smarter, self-hosted AI assistant — multi-user, multi-agent.
Language:Python
Total stars: 2127
#python
#agent, #agenticai, #ai, #aiagent, #aiagents, #localfirst, #longtermmemory

Human-Agent-Society/reef
Continual learning infra for self-improving agents
Language:Python
Total stars: 1667
#python
#agentinfrastructure, #aiagents, #continuallearning, #inference, #llm, #llmtraining, #reinforcementlearning, #selfimprovingagents

xzf-thu/VoiceMem
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
Language:Python
Total stars: 1723
#python
#ai, #aiagents, #aitools, #application, #audiostreaming, #genai, #llm, #longtermmemory, #memory, #memorymanagement, #python, #voiceagent, #voiceassistant

FireRedTeam/FireRedTTS3
FireRedTTS3: Multilingual and Multi-Dialect Voice Cloning with Instruction-Guided Voice Design and Speech Editing
Language:Python
Total stars: 1088
#python

ApodexAI/FrontierAgent
🧩 FrontierAgent, our agent framework, open-sourced alongside it — native command-line TUI, ReAct and Agent Team modes, one command on macOS and Linux, no preinstall, no hard Docker dependency.
Language:Python
Total stars: 3103
#python
#agentorchestration, #agenticai, #agenticframework, #aiagents, #harness, #multiagent, #terminalagent, #tui

lynote-ai/humanize-text
Open-source text humanization pipeline with every intermediate step published. Two LLM rewrites at temp 1.3, then two hops across different NMT engines. Four documented methodologies you can read, modify, and run locally.
Language:Python
Total stars: 2694
#python
#aihumanizer, #aitools, #aiwriting, #humanizeaitext, #humanizetext, #n8n, #paraphrasing, #python, #responsibleai, #texthumanizer, #textprocessing, #textrewriting, #writingassistant

Taichu-AI/ZDTaichu5.0-9B

Language:Python
Total stars: 826
#python

letorig/video-generator-client
Async Python wrapper for Seedance, Kling, MiniMax and Wan video generation. Supports CLI and a local web UI
Language:Python
Total stars: 476
#python
#kling, #klingai, #minimaxh3, #seedance, #seedance25, #videogeneration, #videogenerationapi, #videogenerationtool

FlashML-org/FreeToken
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
Language:Python
Total stars: 12918
#python
#deepseekv4, #edge, #glm, #inference, #minimax, #moe, #qwen, #transformer