AlexsJones/llmfit
Hundreds of models & providers. One command to find what runs on your hardware.
Detects hardware specs (CPU, RAM, GPU/VRAM) and scores models across quality, speed, fit, and context dimensions to recommend which ones run efficiently on your machine. Supports dynamic quantization selection, MoE architectures, multi-GPU setups, and integrates with local runtimes (Ollama, llama.cpp, MLX, Docker Model Runner, LM Studio). Offers both an interactive TUI with vim-like modes and visual model comparison tools, plus CLI output for scripting.
15,685 stars and 4,091 monthly downloads. Actively maintained with 173 commits in the last 30 days.
Stars
15,685
Forks
875
Language
Rust
License
MIT
Category
Last pushed
Mar 13, 2026
Monthly downloads
4,091
Commits (30d)
173
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/AlexsJones/llmfit"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Compare
Related tools
livehl/aimirror
🚀 200倍速!AI时代的下载神器 | Docker/PyPI/HuggingFace/CRAN 全加速 | 并行分片+智能缓存,让下载飞起来
Chen-zexi/vllm-cli
A command-line interface tool for serving LLM using vLLM.
ptimizeroracle/ondine
The LLM Dataset Engine — batch process millions of rows with 100+ providers. Multi-row batching...
victordibia/llmx
An API for Chat Fine-Tuned Large Language Models (llm)
TakatoHonda/sui-lang
粋 (Sui) - A programming language optimized for LLM code generation