gweidart/rs-bpe

A ridiculously fast Python BPE (Byte Pair Encoder) implementation written in Rust

54
/ 100
Established

37 stars and 18,476 monthly downloads. No commits in the last 6 months. Available on PyPI.

Stale 6m No Dependents
Maintenance 0 / 25
Adoption 17 / 25
Maturity 25 / 25
Community 12 / 25

How are scores calculated?

Stars

37

Forks

5

Language

Python

License

MIT

Category

bpe-tokenizers

Last pushed

Mar 19, 2025

Monthly downloads

18,476

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/embeddings/gweidart/rs-bpe"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.