StepanTita/nano-BERT

Nano-BERT is a straightforward, lightweight and comprehensible custom implementation of BERT, inspired by the foundational "Attention is All You Need" paper. The primary objective of this project is to distill the essence of transformers by simplifying the complexities and unnecessary details.

27
/ 100
Experimental

No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 6 / 25
Maturity 9 / 25
Community 12 / 25

How are scores calculated?

Stars

20

Forks

3

Language

Jupyter Notebook

License

MIT

Category

bert-model-frameworks

Last pushed

Oct 19, 2023

Commits (30d)

0

GitHub
Bert Model Frameworks · 31 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/nlp/StepanTita/nano-BERT"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

Tiiiger/bert_score

BERT score for text generation

71

DerwenAI/pytextrank

Python implementation of TextRank algorithms ("textgraphs") for phrase extraction

69

BrikerMan/Kashgari

Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for...

64

asyml/texar

Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. ...

63

yohasebe/wp2txt

A command-line tool to extract plain text from Wikipedia dumps with category and section filtering

57

Explore NLP Tools

All categories Trending NLP directory Insights