​​llmfit - (★11.1k) a terminal tool that right-sizes LLM models to your system's RAM, CPU, and GPU. Detects your hardware, scores each model across quality, speed, fit, and context dimensions, and tells you which ones will actually run well on your machine.

If Ollama is running in your system and llmfit can detect it, then you can pull model directly to your local ollama by pressing d key, which is very convinient.

#hardware #llm #model #ollama