#python #cactus #gemini #gemma #llm #on_device_ai

Needle 2 is a very small tool-calling AI model that can run on low memory, work offline, and return structured results like JSON instead of free text. It helps you build apps that call tools, extract data, and fine-tune models more safely and easily, even on devices with limited RAM.

https://github.com/cactus-compute/needle