guotong1988/BERT-pre-training
multi-gpu pre-training in one machine for BERT without horovod (Data Parallelism)
54
/ 100
Established
171 stars.
No Package
No Dependents
Maintenance
6 / 25
Adoption
10 / 25
Maturity
16 / 25
Community
22 / 25
Stars
171
Forks
53
Language
Python
License
Apache-2.0
Category
Last pushed
Dec 27, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/guotong1988/BERT-pre-training"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
sileod/tasknet
Easy modernBERT fine-tuning and multi-task learning
65
codertimo/BERT-pytorch
Google AI 2018 BERT pytorch implementation
65
920232796/bert_seq2seq
pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。
63
JayYip/m3tl
BERT for Multitask Learning
61
graykode/toeicbert
TOEIC(Test of English for International Communication) solving using pytorch-pretrained-BERT model.
57