#javascript #agent_framework_javascript #ai_agents #crewai #custom_ai_agents #desktop_app #llama3 #llm #llm_application #llm_webui #lmstudio #local_llm #localai #multimodal #nodejs #ollama #rag #vector_database #webui

AnythingLLM is an all-in-one AI app that lets you chat with your documents, use AI agents, and manage multiple users without complicated setup. You can choose from various large language models (LLMs) and vector databases, and it supports different document types like PDF, TXT, and DOCX. It also has a simple chat interface with drag-and-drop functionality and clear citations. You can run it locally or host it remotely, and it includes features like custom AI agents, multi-modal support, and cost-saving measures for managing large documents. This makes it easy to use AI with your documents in a flexible and efficient way.

https://github.com/Mintplex-Labs/anything-llm

#typescript #electron #gpt #llama2 #llamacpp #localai #self_hosted

Jan is a local AI assistant that runs entirely on your device, giving you full control and privacy. It supports various hardware like NVIDIA GPUs, Apple M-series, and Linux systems. You can download and use popular language models like Llama, Gemma, and Mistral without needing an internet connection. Jan also allows you to customize it with extensions and connect to remote AI APIs. The benefit is that you can use AI without sending your data online, keeping your information private and secure.

https://github.com/janhq/jan

#rust #gguf #llm #localai #mlx #skill #unsloth

llmfit is a free terminal tool that automatically checks your computer’s RAM, CPU, and GPU to tell you exactly which large language models will run well on your machine, ranking them by fit, speed, quality, and context. It supports both an interactive visual interface and a command-line mode, works with multi-GPU setups, and suggests the best quantization levels so you never waste time or storage downloading models that won’t work. This saves you from guesswork, trial-and-error testing, and wasted bandwidth, giving you immediate, reliable recommendations for the best local AI models for your specific hardware.

https://github.com/AlexsJones/llmfit