Ki6an/fastT5
⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
589 stars and 860 monthly downloads. No commits in the last 6 months. Available on PyPI.
Stars
589
Forks
74
Language
Python
License
Apache-2.0
Category
Last pushed
Apr 24, 2023
Monthly downloads
860
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/Ki6an/fastT5"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related frameworks
NVIDIA/TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit...
mlcommons/inference
Reference implementations of MLPerf® inference benchmarks
datamade/usaddress
:us: a python library for parsing unstructured United States address strings into address components
GRAAL-Research/deepparse
Deepparse is a state-of-the-art library for parsing multinational street addresses using deep learning
mlcommons/training
Reference implementations of MLPerf® training benchmarks