huggingface/transformers-bloom-inference

Fast Inference Solutions for BLOOM

Archived

/ 100

Emerging

566 stars. No commits in the last 6 months.

Archived Stale 6m No Package No Dependents

Maintenance 0 / 25

Adoption 10 / 25

Maturity 9 / 25

Community 24 / 25

Stars

566

Forks

112

Language

Python

License

Apache-2.0

Category

Last pushed

Oct 09, 2024

Commits (30d)

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/huggingface/transformers-bloom-inference"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Related models

Tencent/TurboTransformers

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc)...

Eamon2009/Transformer-language-model

An educational implementation of a GPT-style language model built from scratch using PyTorch . ...

mit-han-lab/lite-transformer

[ICLR 2020] Lite Transformer with Long-Short Range Attention

mit-han-lab/hardware-aware-transformers

[ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing

LibreTranslate/Locomotive

Toolkit for training/converting LibreTranslate compatible language models 🚂