#rust #gguf #llm #localai #mlx #skill #unsloth

llmfit is a free terminal tool that automatically checks your computer’s RAM, CPU, and GPU to tell you exactly which large language models will run well on your machine, ranking them by fit, speed, quality, and context. It supports both an interactive visual interface and a command-line mode, works with multi-GPU setups, and suggests the best quantization levels so you never waste time or storage downloading models that won’t work. This saves you from guesswork, trial-and-error testing, and wasted bandwidth, giving you immediate, reliable recommendations for the best local AI models for your specific hardware.

https://github.com/AlexsJones/llmfit

#go #agent #agent_framework #ai_agent #ai_coding #cli #coding_agent #deepseek #developer_tools #ink #llm #prompt_caching #r1 #terminal #tool_use #tui #typescript

Reasonix is a DeepSeek-based AI coding agent for your terminal, desktop, or VS Code, and it uses one local engine for all three. You can set it up with a simple config, add plugins and tools, and run it as a single Go binary, which helps you code faster while keeping token costs lower during long sessions.

https://github.com/esengine/DeepSeek-Reasonix

#python #agent_security #ai_agents #ai_security #benchmark #claude #claude_code #codex #cursor #llm_security #mcp #model_context_protocol #prompt_injection #threat_detection

ADR is an enterprise security system for AI agents that watches what agents do, tests them for attacks, detects risky behavior, and is being used in production at Uber; its paper was accepted to MLSys 2026. The benefit to you is better protection for AI tools like Cursor, Claude Code, and Codex, plus a way to find unsafe actions before they cause harm.

https://github.com/uber/ADR

#python #agent_memory #ai #ai_governance #ai_infrastructure #artificial_intelligence #context_engineering #context_graphs #data_engineering #decision_intelligence #developer_tools #explainable_ai #generative_ai #graph_rag #knowledge_graph #llm #ontology #provenance #python #reasoning #semantic_search

Semantica is an open-source tool that turns messy data into clear, connected knowledge graphs for AI. It helps you track where facts came from, explain AI decisions, find conflicts, and keep systems auditable and trustworthy. This benefits you by making AI easier to trust, easier to check, and safer to use in important work like finance, healthcare, legal, and government.

https://github.com/semantica-agi/semantica

#python #ai #ast #claude_code #code_analysis #code_understanding #codebase_search #developer_tools #graph_database #knowledge_graph #llm #mcp #mcp_server #memgraph #monorepo #multi_language #python #rag #retrieval_augmented_generation #semantic_search #tree_sitter

Code-Graph-RAG is an open-source tool that reads a codebase, builds a graph of functions, classes, modules, and links, and lets you ask questions, find code, edit safely, and improve code in plain English. It supports many languages and can run as an MCP server for direct use with AI tools. Benefit: you can understand and change large mixed-language projects faster, with less manual searching and fewer mistakes.

https://github.com/vitali87/code-graph-rag

#python #cactus #gemini #gemma #llm #on_device_ai

Needle 2 is a very small tool-calling AI model that can run on low memory, work offline, and return structured results like JSON instead of free text. It helps you build apps that call tools, extract data, and fine-tune models more safely and easily, even on devices with limited RAM.

https://github.com/cactus-compute/needle

#typescript #agent #agent_harness #agent_os #agentic #ai #ai_agent #ai_agents #artificial_intelligence #claude_code #codex #electron #holaboss #holaos #llm #mcp #memory #model_context_protocol #runtime #typescript #workspace

holaOS is a local-first desktop workspace that lets you run agents like Claude Code, Codex, or its built-in agent together with your tools, files, apps, and shared memory. It supports macOS, Windows, and Linux, includes built-in models or your own keys, and can help you get work done with real browser control, app automation, and ready-made files. This can save you time because one setup works across agents, keeps your context, and lets you produce useful results without switching systems.

https://github.com/holaboss-ai/holaOS

#python #cli #consumer_gpu #dpo #fine_tuning #gguf #huggingface #llm #llmops #local_ai #local_llm #lora #low_vram #machine_learning #ollama #peft #python #pytorch #qlora #sft #transformers

Soup is a tool that helps you fine-tune and post-train large language models with one command, using one config file and little setup. It can work on a local GPU, even a 4 GB laptop GPU for an 8B model with layer streaming, so you can train without SSH or cloud hassle. This saves time, reduces setup pain, and makes model training easier to start and manage.

https://github.com/MakazhanAlpamys/Soup

#python #agent #agent_security #ai_infra #ai_red_teaming #ai_security #llm #llm_evaluation #llm_jailbreak #llm_security #mcp_scan #openclaw_security #prompt_injection #prompt_security #scanner #security #security_tools #skill_scanner #skills_security #vulnerability

A.I.G (AI-Infra-Guard) is a Tencent Zhuque Lab tool for AI red teaming and security checks. It scans AI infrastructure, MCP servers, agent skills, and jailbreak risks, and it can run with Docker, a web UI, or an API. This helps you find weak points early, understand real security risks, and fix problems before they affect your AI systems.

https://github.com/Tencent/AI-Infra-Guard

#typescript #agent_runtime #ai #ai_agent #apache #cli #desktop #electron #event_sourcing #llm #local_first #maka #tool_use #typescript

Maka is a local-first agent workspace that runs on your computer, lets you use your own model connection, and can read files, run tools, and save recoverable work records. This helps you keep data local, control permissions, and recover or continue work more safely.

https://github.com/apache/maka

#javascript #agent_skills #ai_agents #claude #claude_code #claude_code_plugin #cursor_rules #developer_tools #llm #prompt_engineering #yagni

Ponytail is a tool for AI coding agents that tells them to use the simplest safe solution, like native features, shared code, or one-line fixes, instead of extra code. It can cut code, cost, and time while keeping safety checks, validation, and accessibility. For you, this means cleaner code, faster results, and less wasted work.

https://github.com/DietrichGebert/ponytail

#python #bge #colbert #data_pipeline #deep_learning #embeddings #inference #inference_server #information_retrieval #llm #ml #mlops #natural_language_processing #nlp #python #reranking #retrieval #retrieval_augmented_generation #semantic_search #splade #vector_search

SIE is a self-hosted engine for AI agents that runs many open models from one cluster in your cloud. It can handle search, document cleanup, structured output, safety checks, and agent actions through one OpenAI-style API. This helps you use fewer services, keep control of your data, and make setup simpler and cheaper.

https://github.com/superlinked/sie

#python #agent #llm #mathmodel #skills

This tool helps you do math modeling faster by finding, coding, fixing errors, and writing a full paper for you. You can use a desktop app, Docker, or local setup, and it works with many AI models. The benefit is clear: it saves time, gives ready-to-submit paper templates, and helps you produce cleaner, more complete work with less manual effort.

https://github.com/jihe520/MathModelAgent

#jupyter_notebook #cluster_management #deep_learning #distributed #llama #llama2 #llm #machine_learning #mlops #pytorch

Higgsfield is a tool for training huge AI models on many GPUs with less setup pain. It helps manage computers, split work across nodes, queue runs, and track experiments, so you can train faster, avoid environment problems, and keep your work more reproducible.

https://github.com/higgsfield-ai/higgsfield

#python #ai #ai_agents #ai_tools #ai_video #ai_video_editor #auto #auto_highlight #highlight #llm #video #video_editing #video_processing #videos

AutoClip is a tool that downloads videos from YouTube and Bilibili, then uses AI to find the best parts, cut clips, and make collections. It has a web app, real-time progress updates, and easy Docker or one-click setup. This helps you save time, turn long videos into useful highlights, and manage clips more easily.

https://github.com/zhouxiaoka/autoclip

#python #agent_framework #agentic #agentic_ai #agents #ai #ai_agents #anthropic #autonomous_agents #bedrock #generative_ai #harness #llm #llm_agent #mcp #multi_agent_systems #openai #python #sdk #strands_agents #typescript

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

https://github.com/strands-agents/harness-sdk

#python #a_share #agent #ai #ai_agent #akshare #deepseek #fastapi #fintech #langgraph #llm #mcp #openai #pwa #quant #self_hosted #stock #stock_analysis #stock_market #trading_agents #trading_bot

盯盘侠 PanWatch · 自托管 AI 盯盘助手，集成 TradingAgents 多 Agent 投资决策 | A股/港股/美股实时监控、持仓管理、智能分析、全渠道推送

https://github.com/TNT-Likely/PanWatch

#python #aggregator #feishu_bot #llm #mcp #news #openclaw #python #webhook

Horizon is an open-source tool that uses AI to create personalized daily news briefings in English and Chinese. It collects stories from sources such as RSS feeds, Reddit, Hacker News, and GitHub, then filters and removes duplicates based on rules you choose. It can add summaries, background, and community discussion, and deliver briefings by email, WeChat, or other channels. This helps readers keep up with their interests without checking many sources themselves.

https://github.com/Thysrael/Horizon

#c_lang #avx2 #c99 #cpu_inference #deep_learning #from_scratch #inference_engine #kimi_k3 #linear_attention #llm #llm_inference #machine_learning #memory_efficient #mixture_of_experts #moe #mxfp4 #quantization #simd #systems_programming #transformer #zero_dependencies

kimi-k3-in-c runs the Kimi K3 language model on a CPU without a GPU or machine learning framework. It supports text generation and multi-turn text chat on Linux, macOS, and Windows. By loading model data from disk as needed, it can run the full model with limited memory, making it useful on machines that cannot hold the model in RAM. It requires roughly 1.7 TB of free storage, and generation can be slow, especially with less memory or slower disks.

https://github.com/FareedKhan-dev/kimi-k3-in-c

#python #ai #claude #hacs #home_assistant #home_automation #llm #mcp #model_context_protocol

HA-MCP connects AI assistants such as Claude and ChatGPT to Home Assistant, letting users manage their smart home through everyday language. It can control devices, create and edit automations, scripts and dashboards, check device history, and help diagnose problems. It also supports backups and safety controls such as read-only access and approval policies. This makes it easier to configure and maintain a smart home without doing every task by hand.

https://github.com/homeassistant-ai/ha-mcp