mkartawijaya/dango
An easy to use tokenizer for Japanese text, aimed at language learners and non-linguists
No commits in the last 6 months. Available on PyPI.
Stars
25
Forks
3
Language
Python
License
BSD-3-Clause
Category
Last pushed
Nov 21, 2021
Monthly downloads
157
Commits (30d)
0
Dependencies
3
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/mkartawijaya/dango"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
EmilStenstrom/conllu
A CoNLL-U parser that takes a CoNLL-U formatted string and turns it into a nested python dictionary.
OpenPecha/Botok
🏷 བོད་ཏོག [pʰøtɔk̚] Tibetan word tokenizer in Python
taishi-i/nagisa
A Japanese tokenizer based on recurrent neural networks
zaemyung/sentsplit
A flexible sentence segmentation library using CRF model and regex rules
natasha/razdel
Rule-based token, sentence segmentation for Russian language