#rust #ai #ai_engineering #anthropic #artificial_intelligence #deep_learning #genai #generative_ai #gpt #large_language_models #llama #llm #llmops #llms #machine_learning #ml #ml_engineering #mlops #openai #python #rust

TensorZero is a free, open-source tool that helps you build and improve large language model (LLM) applications by using real-world data and feedback. It gives you one simple API to connect with all major LLM providers, collects data from your app’s use, and lets you easily test and improve prompts, models, and strategies. You can see how your LLMs perform, compare different options, and make them smarter, faster, and cheaper over time—all while keeping your data private and under your control. This means you get better results with less effort and cost, and your apps keep improving as you use them[1][2][3].

https://github.com/tensorzero/tensorzero

#typescript #ai_gateway #gateway #generative_ai #hacktoberfest #langchain #llama_index #llmops #llms #openai #prompt_engineering #router

The AI Gateway by Portkey lets you connect to over 1600 AI models quickly and securely through one simple API, making it easy to integrate any language, vision, or audio AI model in under two minutes. It ensures fast responses with less than 1ms latency, automatic retries, load balancing, and fallback options to keep your AI apps reliable and scalable. It also offers strong security with role-based access, guardrails, and compliance with standards like SOC2 and GDPR. You can save costs with smart caching and optimize usage without changing your code. This helps you build powerful, cost-effective, and secure AI applications faster and with less hassle.

https://github.com/Portkey-AI/gateway

#python #ai #faiss #gpt_oss #langchain #llama_index #llm #localstorage #offline_first #ollama #privacy #python #rag #retrieval_augmented_generation #vector_database #vector_search #vectors

LEANN is a tiny, powerful vector database that lets you turn your laptop into a personal AI assistant capable of searching millions of documents using 97% less storage than traditional systems without losing accuracy. It works by storing a compact graph and computing embeddings only when needed, saving huge space and keeping your data private on your device. You can search your files, emails, browser history, chat logs, live data from platforms like Slack and Twitter, and even codebases—all locally without cloud costs. This means fast, private, and efficient AI-powered search and retrieval on your own laptop.

https://github.com/yichuan-w/LEANN

#go #gemma3 #go #gpt_oss #granite4 #llama #llama3 #llm #on_device_ai #phi3 #qwen3 #qwen3vl #sdk #stable_diffusion #vlm

NexaSDK runs AI models locally on CPUs, GPUs, and NPUs with a single command, supports GGUF/MLX/.nexa formats, and offers NPU-first Android and macOS support for fast, multimodal (text, image, audio) inference, plus an OpenAI‑compatible API for easy integration. This gives you low-latency, private on-device AI across laptops, phones, and embedded systems, reduces cloud costs and data exposure, and lets you deploy and test new models immediately on target hardware for faster development and better user experience.

https://github.com/NexaAI/nexa-sdk

#jupyter_notebook #chinese_llm #chinese_nlp #finetune #generative_ai #instruct_gpt #instruction_set #llama #llm #lora #open_models #open_source #open_source_models #qlora

AirLLM is a tool that lets you run very large AI models on computers with limited memory by using a smart layer-by-layer loading technique instead of traditional compression methods. You can run a 70-billion-parameter model on just 4GB of GPU memory, or even a 405-billion-parameter model on 8GB, without losing model quality. The benefit is that you can use powerful AI models on affordable hardware without expensive upgrades, and the tool also offers optional compression features that can speed up performance by up to 3 times while maintaining accuracy.

https://github.com/lyogavin/airllm

#python #ai #claude #gemini #llama #llm #openai

You can access powerful AI language models for free or with trial credits through multiple legitimate platforms. Services like OpenRouter, Google AI Studio, Groq, and Mistral offer free tiers with varying request limits, while others like Fireworks, Baseten, and Inference.net provide trial credits ranging from $1 to $30. These platforms support diverse models including Llama, Gemma, Qwen, and DeepSeek, enabling you to build and test AI applications without upfront costs. The benefit is clear: you can prototype, develop, and deploy AI-powered features while managing your budget effectively, with options to scale up as your needs grow.

https://github.com/cheahjs/free-llm-api-resources

#typescript #analytics #autogen #evaluation #langchain #large_language_models #llama_index #llm #llm_evaluation #llm_observability #llmops #monitoring #observability #open_source #openai #playground #prompt_engineering #prompt_management #self_hosted #ycombinator

Langfuse is a free, open-source platform to build, monitor, evaluate, and debug AI apps using large language models (LLMs). It offers tracing for app logic, prompt management, evaluations, datasets, a playground, and easy integrations like OpenAI, LangChain, and LlamaIndex. Deploy it on Langfuse Cloud (free tier) or self-host with Docker in minutes. This helps you quickly spot issues, improve prompts without slowing apps, test reliably, and speed up development—saving time and boosting AI performance.

https://github.com/langfuse/langfuse

#python #ai_agents #amd #comfyui #docker #llama_cpp #llm #local_ai #n8n #nvidia #open_webui #rag #self_hosted #speech_to_text #strix_halo #text_to_speech #workflow_automation

Dream Server lets you run AI on your own machine instead of renting it from a cloud service. It works on Linux, Windows, and macOS, and it can set up chat, voice, agents, search, image tools, and privacy tools with one command. The main benefit is more control: your data stays with you, costs can be lower, and you can keep using AI even without a cloud account.

https://github.com/Light-Heart-Labs/DreamServer

#python #agentic_ai #agentic_workflow #agents #function_calling #llama_cpp #llamafile #llm #ollama #python #self_hosted #tool_calling

Forge is a Python tool that makes self-hosted LLM tool-calling more reliable. It helps local models handle multi-step tasks with guardrails, better context control, and support for Ollama, llama-server, Llamafile, and Anthropic. You can use it as a workflow runner, middleware, or proxy server with OpenAI-style clients. The benefit is fewer broken tool calls, better results on small models, and easier setup for agent apps, chat tools, and long-running sessions.

https://github.com/antoinezambelli/forge

#swift #ai #dictation #ios #llama_cpp #macos #swift

FluidVoice is a free, open source macOS app that turns speech into text and can also control your Mac by voice. It works mostly on your Mac, so your voice and text stay private unless you choose cloud AI, and it supports fast dictation, live text preview, and optional smart formatting.

https://github.com/altic-dev/FluidVoice