Morizeyao/GPT2-Chinese

Supports multiple tokenization strategies (character-level, word-level, and BPE) and integrates with HuggingFace Transformers, enabling training on diverse Chinese text domains from classical poetry to novels with configurable model depth and batch sizes. Includes pre-trained models for specialized domains (ancient Chinese, lyrics, couplets) available on Hugging Face Model Hub, alongside utilities for perplexity evaluation and batch text generation with customizable sampling parameters.

7,598 stars. No commits in the last 6 months.