StayLameBro/backburner
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
Language: Python
#apple_silicon #ios #iphone #llama_cpp #llm_inference #local_llm #macos #metal #qwen #sme2 #speculative_decoding
Stars: 693 Issues: 4 Forks: 66
https://github.com/StayLameBro/backburner