LukasHedegaard/pytorch-benchmark
Easily benchmark PyTorch model FLOPs, latency, throughput, allocated gpu memory and energy consumption
109 stars. Used by 1 other package. No commits in the last 6 months. Available on PyPI.
Stars
109
Forks
11
Language
Python
License
Apache-2.0
Category
Last pushed
Aug 25, 2023
Commits (30d)
0
Dependencies
8
Reverse dependents
1
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/LukasHedegaard/pytorch-benchmark"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
open-mmlab/mmdeploy
OpenMMLab Model Deployment Framework
triton-inference-server/server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
gpu-mode/Triton-Puzzles
Puzzles for learning Triton
hyperai/tvm-cn
TVM Documentation in Chinese Simplified / TVM 中文文档
triton-inference-server/model_analyzer
Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory...