#python #deepseek #deepseek_r1 #fine_tuning #finetuning #gemma #gemma2 #llama #llama3 #llm #llms #lora #mistral #phi3 #qlora #unsloth

Using Unsloth.ai, you can finetune AI models like Llama, Mistral, and others up to 2x faster and with 70% less memory. The process is beginner-friendly; you just need to add your dataset, click "Run All" in the provided notebooks, and you'll get a faster, finetuned model that can be exported or uploaded to platforms like Hugging Face. This saves time and resources, making it easier to work with large AI models without needing powerful hardware. Additionally, Unsloth supports various features like 4-bit quantization, long context windows, and integration with tools from Hugging Face, making it a powerful tool for AI model development.

https://github.com/unslothai/unsloth

#rust #gguf #llm #localai #mlx #skill #unsloth

llmfit is a free terminal tool that automatically checks your computer’s RAM, CPU, and GPU to tell you exactly which large language models will run well on your machine, ranking them by fit, speed, quality, and context. It supports both an interactive visual interface and a command-line mode, works with multi-GPU setups, and suggests the best quantization levels so you never waste time or storage downloading models that won’t work. This saves you from guesswork, trial-and-error testing, and wasted bandwidth, giving you immediate, reliable recommendations for the best local AI models for your specific hardware.

https://github.com/AlexsJones/llmfit