GitHub Trends
11K subscribers
15.8K links
See what the GitHub community is most excited about today.

A bot automatically fetches new repositories from https://github.com/trending and sends them to the channel.

Author and maintainer: https://github.com/katursis
Download Telegram
#python #agents #generative_ai_tools #llamacpp #llm #onnx #openvino #parsing #retrieval_augmented_generation #small_specialized_models

llmware is a powerful, easy-to-use platform that helps you build AI applications using small, specialized language models designed for business tasks like question-answering, summarization, and data extraction. It supports private, secure deployment on your own machines without needing expensive GPUs, making it cost-effective and safe for enterprise use. You can organize and search your documents, run smart queries, and combine knowledge with AI to get accurate answers quickly. It also offers many ready-to-use models and examples, plus tools for building chatbots and agents that automate complex workflows. This helps you save time, improve accuracy, and securely leverage AI for your business needs[1][3][5].

https://github.com/llmware-ai/llmware
#shell #bonsai #llamacpp #llm #mlx #prism_ml #small_models

You can run powerful Bonsai 27B AI models locally on your iPhone, Mac, or laptop without needing cloud servers. The 1-bit version fits in just 3.9 GB, allowing a 27-billion-parameter model (with vision and reasoning) to run on a phone like the iPhone 17 Pro, while the Ternary version offers higher quality at 5.9 GB. This gives you private, fast, and offline AI for chat, image analysis, and tool use, with up to 262K token context and 90–95% of full-precision performance.

https://github.com/PrismML-Eng/Bonsai-demo
👍1