1998code/SwiftGlass
Glassy Everything, even Old Devices. [ AI Assistant available below ]
Language: Swift
#apple #glass #ios #ipados #macos #swift #swiftglass #swiftui #tvos #visionos #watchos
Stars: 267 Issues: 0 Forks: 11
https://github.com/1998code/SwiftGlass
Glassy Everything, even Old Devices. [ AI Assistant available below ]
Language: Swift
#apple #glass #ios #ipados #macos #swift #swiftglass #swiftui #tvos #visionos #watchos
Stars: 267 Issues: 0 Forks: 11
https://github.com/1998code/SwiftGlass
GitHub
GitHub - 1998code/SwiftGlass: Glassy Everything, even Old Devices. [ AI Assistant available below ]
Glassy Everything, even Old Devices. [ AI Assistant available below ] - 1998code/SwiftGlass
dipampaul17/KVSplit
Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.
Language: Python
#apple_silicon #generative_ai #kv_cache #llama_cpp #llm #m1 #m2 #m3 #memory_optimization #metal #optimization #quantization
Stars: 222 Issues: 1 Forks: 5
https://github.com/dipampaul17/KVSplit
Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.
Language: Python
#apple_silicon #generative_ai #kv_cache #llama_cpp #llm #m1 #m2 #m3 #memory_optimization #metal #optimization #quantization
Stars: 222 Issues: 1 Forks: 5
https://github.com/dipampaul17/KVSplit
GitHub
GitHub - dipampaul17/KVSplit: Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache…
Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with &am...