BaseMax/go-token-boundary

A Go-based CLI tool for analyzing and visualizing token boundaries in natural language text using different tokenization strategies. A tool for analyzing and visualizing token boundaries in natural language text.

15
/ 100
Experimental
No Package No Dependents
Maintenance 6 / 25
Adoption 0 / 25
Maturity 9 / 25
Community 0 / 25

How are scores calculated?

Stars

—

Forks

—

Language

Go

License

MIT

Category

go-nlp-libraries

Last pushed

Dec 20, 2025

Commits (30d)

0

GitHub
Go NLP Libraries · 77 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/nlp/BaseMax/go-token-boundary"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

codingpot/kiwigo

https://github.com/bab2min/Kiwi for go

46

aaaton/golem

A lemmatizer implemented in Go

46

habeanf/yap

Yet Another (natural language) Parser

45

abadojack/whatlanggo

Natural language detection library for Go

44

ikawaha/kagome-dict

Dictionary Library for Kagome v2

44

Explore NLP Tools

All categories Trending NLP directory Insights