RunanywhereAI/RCLI
Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG
Language: C++
#ai_assistant #apple_silicon #kitten_tts #kokoro_tts #lfm2 #llama_cpp #llm #local_ai #metal #on_device_ai #parakeet #qwen3 #rag #speech_to_text #text_to_speech #tool_calling #voice_assistant
Stars: 627 Issues: 10 Forks: 19
https://github.com/RunanywhereAI/RCLI

gavamedia/deltafin
Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.
Language: Python
#kimi #kimi_k3 #local_ai #local_llm
Stars: 497 Issues: 4 Forks: 54
https://github.com/gavamedia/deltafin

magicrew/doc7
Turn documents into AI-ready Markdown with visual understanding
Language: Go
#document_ai #docx_to_markdown #local_ai #markdown #multimodal #open_source #pdf_to_markdown #vision_language_model
Stars: 459 Issues: 0 Forks: 9
https://github.com/magicrew/doc7

mizorewww/laya-mlx
Native MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.
Language: Python
#apple_silicon #decision_model #inference #laya #local_ai #machine_learning #mlx #modernbert #system_one #typed_decisions
Stars: 2085 Issues: 4 Forks: 105
https://github.com/mizorewww/laya-mlx

mizorewww/laya-coreml
Local Laya typed decisions on Apple Core ML and Neural Engine. Validated ports, ~5 ms short decisions on M3 Max, reproducible speed and energy benchmarks.
Language: Python
#apple_neural_engine #apple_silicon #coreml #decision_model #laya #local_ai #modernbert #on_device_ai #typed_decisions
Stars: 1004 Issues: 1 Forks: 65
https://github.com/mizorewww/laya-coreml