imcaspar/gpt2-ml
GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型
Implements simplified training scripts based on Grover architecture with TPU support, and adapts BERT's tokenizer for multilingual corpus compatibility using CLUE vocabulary. Provides two 1.5B Chinese pretrained checkpoints trained on 15-30GB corpora with different tokenization schemes (BERT vs. CLUE tokens), optimized via Cloud TPU Pod for production-ready text generation tasks.
1,703 stars. No commits in the last 6 months.
Stars
1,703
Forks
330
Language
Python
License
Apache-2.0
Category
Last pushed
May 22, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/imcaspar/gpt2-ml"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Compare
Related tools
graykode/gpt-2-Pytorch
Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation
Morizeyao/GPT2-Chinese
Chinese version of GPT2 training code, using BERT tokenizer.
gyunggyung/KoGPT2-FineTuning
🔥 Korean GPT-2, KoGPT2 FineTuning cased. 한국어 가사 데이터 학습 🔥
liucongg/GPT2-NewsTitle
Chinese NewsTitle Generation Project by GPT2.带有超级详细注释的中文GPT2新闻标题生成项目。
lipiji/Guyu
Chinese GPT2: pre-training and fine-tuning framework for text generation