IndoNLP/indonlu
The first-ever vast natural language processing benchmark for Indonesian Language. We provide multiple downstream tasks, pre-trained IndoBERT models, and a starter code! (AACL-IJCNLP 2020)
Encompasses 12 diverse NLU tasks spanning sequence classification, tagging, and semantic similarity, with evaluation infrastructure on CodaLab for reproducible benchmarking. The IndoBERT models employ a two-phase pretraining approach on Indo4B—a 4-billion-word, 20+ GB Indonesian corpus—with both base and lite variants available on Hugging Face. Also includes FastText embeddings trained on the same corpus, enabling practitioners to choose between transformer-based and lightweight word vector approaches for downstream Indonesian NLP tasks.
638 stars. No commits in the last 6 months.
Stars
638
Forks
211
Language
Jupyter Notebook
License
Apache-2.0
Category
Last pushed
Nov 16, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/IndoNLP/indonlu"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
malaysia-ai/malaya
Natural Language Toolkit for Malaysian language, https://malaya.readthedocs.io/
louisowen6/NLP_bahasa_resources
A Curated List of Dataset and Usable Library Resources for NLP in Bahasa Indonesia
kirralabs/indonesian-NLP-resources
data resource untuk NLP bahasa indonesia
wongnai/wongnai-corpus
Collection of Wongnai's datasets
rizalespe/Dataset-Sentimen-Analisis-Bahasa-Indonesia
Repositori ini merupakan kumpulan dataset terkait analisis sentimen Berbahasa Indonesia. Apabila...