InfraWhisperer/llmtop
htop for your LLM inference cluster
36
/ 100
Emerging
No Package
No Dependents
Maintenance
13 / 25
Adoption
4 / 25
Maturity
9 / 25
Community
10 / 25
Stars
6
Forks
1
Language
Go
License
—
Category
Last pushed
Mar 19, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/InfraWhisperer/llmtop"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
trymirai/uzu
A high-performance inference engine for AI models
62
justrach/bhumi
⚡ Bhumi – The fastest AI inference client for Python, built with Rust for unmatched speed,...
54
lipish/llm-connector
LLM Connector - A unified interface for connecting to various Large Language Model providers
49
keyvank/femtoGPT
Pure Rust implementation of a minimal Generative Pretrained Transformer
49
ShelbyJenkins/llm_client
The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from...
45