llmBench and ollama-benchmark

These two tools are competitors, as both aim to measure the performance and efficiency of LLM workloads, particularly those run locally with frameworks like Ollama, making it likely a user would choose one over the other for a given benchmarking task.

llmBench
38
Emerging
ollama-benchmark
39
Emerging
Maintenance 13/25
Adoption 6/25
Maturity 9/25
Community 10/25
Maintenance 2/25
Adoption 9/25
Maturity 16/25
Community 12/25
Stars: 24
Forks: 3
Downloads:
Commits (30d): 0
Language: Python
License: MIT
Stars: 76
Forks: 8
Downloads:
Commits (30d): 0
Language: Python
License: MIT
No Package No Dependents
Stale 6m No Package No Dependents

About llmBench

AnkitNayak-eth/llmBench

llmBench is a high-depth benchmarking tool designed to measure the raw performance of local LLM runtimes (Ollama, llama.cpp) while providing deep hardware intelligence.

About ollama-benchmark

cloudmercato/ollama-benchmark

Handy tool to measure the performance and efficiency of LLMs workloads.

Related comparisons

Scores updated daily from GitHub, PyPI, and npm data. How scores work