AndersonBY/deepseek-tokenizer

DeepSeek Tokenizer is an efficient and lightweight tokenization library with no third-party runtime dependencies, making it a streamlined and efficient choice for tokenization tasks.

57
/ 100
Established

42 stars and 4,569 monthly downloads. Available on PyPI.

No License No Dependents
Maintenance 10 / 25
Adoption 16 / 25
Maturity 17 / 25
Community 14 / 25

How are scores calculated?

Stars

42

Forks

7

Language

Python

License

Last pushed

Feb 19, 2026

Monthly downloads

4,569

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/nlp/AndersonBY/deepseek-tokenizer"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.