tiktoken-go and gotoken
Maintenance
2/25
Adoption
10/25
Maturity
16/25
Community
20/25
Maintenance
0/25
Adoption
1/25
Maturity
16/25
Community
12/25
Stars: 895
Forks: 102
Downloads: —
Commits (30d): 0
Language: Go
License: MIT
Stars: 1
Forks: 1
Downloads: —
Commits (30d): 0
Language: Go
License: MIT
Stale 6m
No Package
No Dependents
Stale 6m
No Package
No Dependents
About tiktoken-go
pkoukk/tiktoken-go
go version of tiktoken
This is a Go language implementation of OpenAI's tiktoken library. It helps developers working with Go applications to accurately count and tokenize text for use with various OpenAI models, such as GPT-3.5 and GPT-4. You provide text or chat messages, and it outputs the corresponding token IDs and the total token count.
Go-development
LLM-integration
OpenAI-API
text-tokenization
natural-language-processing
About gotoken
peterheb/gotoken
Gotoken is a pure-Go implementation of the Python library openai/tiktoken.
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work