LowinLi/transformers-stream-generator
This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
Used by 10 other packages. No commits in the last 6 months. Available on PyPI.
Stars
96
Forks
19
Language
Python
License
MIT
Category
Last pushed
Mar 11, 2024
Commits (30d)
0
Reverse dependents
10
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/LowinLi/transformers-stream-generator"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
ystemsrx/mini-nanoGPT
One-click training of your own GPT. Training a GPT has never been easier for beginners. /...
jaymody/picoGPT
An unnecessarily tiny implementation of GPT-2 in NumPy.
kamalkraj/minGPT-TF
A minimal TF2 re-implementation of the OpenAI GPT training
Eamon2009/Codeformer-A.I
A character-level GPT transformer built from scratch in PyTorch, trained on Linux kernel C...
kyegomez/AttentionGrid
A network of attention mechanisms at your fingertips. Unleash the potential of attention...