#python #cactus #gemini #gemma #llm #on_device_ai
Needle 2 is a very small tool-calling AI model that can run on low memory, work offline, and return structured results like JSON instead of free text. It helps you build apps that call tools, extract data, and fine-tune models more safely and easily, even on devices with limited RAM.
https://github.com/cactus-compute/needle
Needle 2 is a very small tool-calling AI model that can run on low memory, work offline, and return structured results like JSON instead of free text. It helps you build apps that call tools, extract data, and fine-tune models more safely and easily, even on devices with limited RAM.
https://github.com/cactus-compute/needle
GitHub
GitHub - cactus-compute/needle: Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, structured extraction…
Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers. - cactus-compute...