kyegomez/FlashMHA
An simple pytorch implementation of Flash MultiHead Attention
No commits in the last 6 months. Available on PyPI.
Stars
22
Forks
4
Language
Jupyter Notebook
License
MIT
Category
Last pushed
Feb 05, 2024
Monthly downloads
23
Commits (30d)
0
Dependencies
2
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/kyegomez/FlashMHA"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
philipperemy/keras-attention
Keras Attention Layer (Luong and Bahdanau scores).
tatp22/linformer-pytorch
My take on a practical implementation of Linformer for Pytorch.
ematvey/hierarchical-attention-networks
Document classification with Hierarchical Attention Networks in TensorFlow. WARNING: project is...
thushv89/attention_keras
Keras Layer implementation of Attention for Sequential models
datalogue/keras-attention
Visualizing RNNs using the attention mechanism