#python #cli #consumer_gpu #dpo #fine_tuning #gguf #huggingface #llm #llmops #local_ai #local_llm #lora #low_vram #machine_learning #ollama #peft #python #pytorch #qlora #sft #transformers
Soup is a tool that helps you fine-tune and post-train large language models with one command, using one config file and little setup. It can work on a local GPU, even a 4 GB laptop GPU for an 8B model with layer streaming, so you can train without SSH or cloud hassle. This saves time, reduces setup pain, and makes model training easier to start and manage.
https://github.com/MakazhanAlpamys/Soup
Soup is a tool that helps you fine-tune and post-train large language models with one command, using one config file and little setup. It can work on a local GPU, even a 4 GB laptop GPU for an 8B model with layer streaming, so you can train without SSH or cloud hassle. This saves time, reduces setup pain, and makes model training easier to start and manage.
https://github.com/MakazhanAlpamys/Soup
GitHub
GitHub - MakazhanAlpamys/Soup: Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. - MakazhanAlpamys/Soup