#shell #bonsai #llamacpp #llm #mlx #prism_ml #small_models
You can run powerful Bonsai 27B AI models locally on your iPhone, Mac, or laptop without needing cloud servers. The 1-bit version fits in just 3.9 GB, allowing a 27-billion-parameter model (with vision and reasoning) to run on a phone like the iPhone 17 Pro, while the Ternary version offers higher quality at 5.9 GB. This gives you private, fast, and offline AI for chat, image analysis, and tool use, with up to 262K token context and 90–95% of full-precision performance.
https://github.com/PrismML-Eng/Bonsai-demo
You can run powerful Bonsai 27B AI models locally on your iPhone, Mac, or laptop without needing cloud servers. The 1-bit version fits in just 3.9 GB, allowing a 27-billion-parameter model (with vision and reasoning) to run on a phone like the iPhone 17 Pro, while the Ternary version offers higher quality at 5.9 GB. This gives you private, fast, and offline AI for chat, image analysis, and tool use, with up to 262K token context and 90–95% of full-precision performance.
https://github.com/PrismML-Eng/Bonsai-demo
GitHub
GitHub - PrismML-Eng/Bonsai-demo: Bonsai Demo
Bonsai Demo. Contribute to PrismML-Eng/Bonsai-demo development by creating an account on GitHub.
👍2
#shell #graphics #infra #postgres #service #toolbox #yours
Pigsty helps you set up and run PostgreSQL fast, with high availability, backup, monitoring, and many extensions on Linux or Docker. It supports small to large setups, so you can save time, reduce mistakes, and manage a reliable database system with one command.
https://github.com/pgsty/pigsty
Pigsty helps you set up and run PostgreSQL fast, with high availability, backup, monitoring, and many extensions on Linux or Docker. It supports small to large setups, so you can save time, reduce mistakes, and manage a reliable database system with one command.
https://github.com/pgsty/pigsty
GitHub
GitHub - pgsty/pigsty: Enterprise-Grade OSS PostgreSQL Distribution with HA, PITR, IaC, Monitor, 12 kernel forks and 575 PG extensions.…
Enterprise-Grade OSS PostgreSQL Distribution with HA, PITR, IaC, Monitor, 12 kernel forks and 575 PG extensions. Best-of-breed products integrated as a platform. Self-host Postgres like a Pro! - pg...
#shell #a311d #allwinner #amlogic #h96 #hg680p #hk1 #n1 #openwrt #r66s #r68s #rockchip #s905 #s905d #s905x #s905x2 #s905x3 #s912 #s922x #ugoos #x96
OpenWrt turns a TV box or router into a flexible Linux system you can customize with many packages. You can install it, update the system or kernel, make swap space, back up the old system, and reset it if needed. This helps you give old hardware new life, add features you want, and fix problems more easily.
https://github.com/ophub/amlogic-s9xxx-openwrt
OpenWrt turns a TV box or router into a flexible Linux system you can customize with many packages. You can install it, update the system or kernel, make swap space, back up the old system, and reset it if needed. This helps you give old hardware new life, add features you want, and fix problems more easily.
https://github.com/ophub/amlogic-s9xxx-openwrt
GitHub
GitHub - ophub/amlogic-s9xxx-openwrt: Supports running OpenWrt on Amlogic, Allwinner, and Rockchip devices. Support a311d, s922x…
Supports running OpenWrt on Amlogic, Allwinner, and Rockchip devices. Support a311d, s922x, s905x3, s905x2, s912, s905d, s905x, s905w, s905, s905l, rk3588, rk3568, rk3399, rk3328, h6, etc. - ophub/...