rjmacarthy/string-tokeniser
An implementation of Keras Tokenizer in JavaScript.
21
/ 100
Experimental
No commits in the last 6 months. Available on npm.
Stale 6m
Maintenance
0 / 25
Adoption
3 / 25
Maturity
18 / 25
Community
0 / 25
Stars
3
Forks
—
Language
JavaScript
License
MIT
Category
Last pushed
May 10, 2024
Commits (30d)
0
Dependencies
1
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/rjmacarthy/string-tokeniser"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
SauravP97/hf-tokenizer-visualizer
Visualize HuggingFace Byte-Pair Encoding (BPE) Tokenizer encoding process
35
DePasqualeOrg/swift-tiktoken
A pure Swift implementation of OpenAI's tiktoken tokenizer
30
Usama3627/tokenizer
Implementation of BPE Tokenizer in Rust
24
andikaseptiadi/local-code-model
🛠️ Build a pure Go GPT-style transformer from scratch to grasp the fundamentals of large...
24
twinnydotdev/toxe
SentencePiece tokenizer for cross-encoders
23