SJTU-IPADS/PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
Language: C
#falcon #large_language_models #llama #llm #llm_inference #local_inference
Stars: 792 Issues: 8 Forks: 32
https://github.com/SJTU-IPADS/PowerInfer

jasonjmcghee/rem
An open source approach to locally record and enable searching everything you view on your Apple Silicon.
Language: Swift
#local #macos #memory #search #swift #swiftui
Stars: 352 Issues: 0 Forks: 9
https://github.com/jasonjmcghee/rem

masterFoad/NanoSage
Local LLM Powered Recursive Search & Smart Knowledge Explorer
Language: Python
#ai_researcher #algorithms #cli #gemma #knowledge_base #local #monte_carlo_search #nanosage #ollama #python3 #rag #recursive_search #report #small_language_models
Stars: 185 Issues: 6 Forks: 20
https://github.com/masterFoad/NanoSage

fingerthief/recommendarr
An AI driven recommendation system based on Radarr and Sonarr library information
Language: Vue
#ai #artificial_intelligence #local #local_llm_integration #radarr #recommendation #self_hosted #sonarr #vue #vuejs
Stars: 220 Issues: 17 Forks: 6
https://github.com/fingerthief/recommendarr

oxbshw/LLM-Agents-Ecosystem-Handbook
One-stop handbook for building, deploying, and understanding LLM agents with 60+ skeletons, tutorials, ecosystem guides, and evaluation tools.
Language: Python
#ai #ai_agent #ai_agents #fine_tuning #finetuning_llms #freamework #llm #llmops #local_development #mcp_server #memory #rag #rag_chatbot #voice_agent
Stars: 198 Issues: 0 Forks: 29
https://github.com/oxbshw/LLM-Agents-Ecosystem-Handbook

deta/surf
AI Notebooks
Language: TypeScript
#local #productivity #rust #svelte #typescript
Stars: 458 Issues: 5 Forks: 25
https://github.com/deta/surf

fspecii/ace-step-ui
🎵 The Ultimate Open Source Suno Alternative - Professional UI for ACE-Step 1.5 AI Music Generation. Free, local, unlimited. Stop paying for Suno!
Language: JavaScript
#ace_step #ai #ai_music #local_first #music #music_generation #open_source #react #suno_alternative #typescript
Stars: 327 Issues: 14 Forks: 45
https://github.com/fspecii/ace-step-ui

RunanywhereAI/RCLI
Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG
Language: C++
#ai_assistant #apple_silicon #kitten_tts #kokoro_tts #lfm2 #llama_cpp #llm #local_ai #metal #on_device_ai #parakeet #qwen3 #rag #speech_to_text #text_to_speech #tool_calling #voice_assistant
Stars: 627 Issues: 10 Forks: 19
https://github.com/RunanywhereAI/RCLI

marswaveai/TypeNo
A free, open source, privacy-first voice input app for macOS.
Language: Swift
#accessibility #dictation #local_first #macos #menu_bar_app #open_source #privacy #productivity #speech_to_text #swift #voice_input
Stars: 624 Issues: 2 Forks: 47
https://github.com/marswaveai/TypeNo

fikrikarim/parlor
On-device, real-time multimodal AI. Have natural voice and vision conversations with an AI that runs entirely on your machine. Powered by Gemma 4 E2B and Kokoro.
Language: HTML
#apple_silicon #gemma #kokoro #litert_lm #local_llm #mlx #multimodal #on_device_ai #python #real_time #speech_recognition #text_to_speech #voice_assistant
Stars: 1183 Issues: 3 Forks: 114
https://github.com/fikrikarim/parlor