CLUEbenchmark/CLUECorpus2020
Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料
Extracted from Common Crawl and cleaned to high quality standards, the corpus includes a specialized simplified Chinese vocabulary (8,021 tokens) optimized for NLP tasks, reducing token overhead compared to Google's multilingual vocab. Pre-formatted for direct use in BERT and masked language model training, experiments demonstrate competitive performance on CLUE benchmark tasks with equivalent or smaller data volumes.
1,002 stars.
Stars
1,002
Forks
83
Language
—
License
MIT
Category
Last pushed
Feb 06, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/CLUEbenchmark/CLUECorpus2020"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
acl-org/acl-anthology
Data and software for building the ACL Anthology.
anoopkunchukuttan/indic_nlp_library
Resources and tools for Indian language Natural Language Processing
SudhirGadhvi/open-vernacular-ai-kit
Clean Indian code-mixed text before it reaches your LLM.
Separius/awesome-sentence-embedding
A curated list of pretrained sentence and word embedding models
KennethEnevoldsen/scandinavian-embedding-benchmark
A Scandinavian Benchmark for sentence embeddings