zxuu/Self-Attention

Transformer的完整实现。详细构建Encoder、Decoder、Self-attention。以实际例子进行展示，有完整的输入、训练、预测过程。可用于学习理解self-attention和Transformer

/ 100

Emerging

127 stars. No commits in the last 6 months.

No License Stale 6m No Package No Dependents

Maintenance 2 / 25

Adoption 10 / 25

Maturity 8 / 25

Community 18 / 25

Stars

127

Forks

Language

Python

License

—

Category

Last pushed

Apr 10, 2025

Commits (30d)

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/nlp/zxuu/Self-Attention"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

luozhouyang/transformers-keras

Transformer-based models implemented in tensorflow 2.x(using keras).

xv44586/toolkit4nlp

transformers implement (architecture, task example, serving and more)

ufal/neuralmonkey

An open-source tool for sequence learning in NLP built on TensorFlow.

uzaymacar/attention-mechanisms

Implementations for a family of attention mechanisms, suitable for all kinds of natural language...

graykode/xlnet-Pytorch

Simple XLNet implementation with Pytorch Wrapper