SCBENCH: A KV CACHE-CENTRIC ANALYSIS OF LONG-CONTEXT METHODS
https://arxiv.org/pdf/2412.10319
#MInference #LLMLingua #SnapKV #Jamba #KIVI #kvcache #benchmarks

#unsloth #team #distributed_sft #sft #fine_tuning
https://github.com/unslothai/unsloth/issues/1707#issuecomment-2658933732

#unsloth #vs #torchtune #vs #axolotl #team #hyperbolic #modal #wandb
https://x.com/hyperbolic_labs/status/1910497498826989831
https://modal.com/blog/fine-tuning-llms
https://wandb.ai/augmxnt/train-bench/reports/Trainer-performance-comparison-torchtune-vs-axolotl-vs-Unsloth---Vmlldzo4MzU3NTAx