juliasilge/tidytext

Converts text to one-token-per-row dataframes via `unnest_tokens()`, enabling seamless integration with dplyr, tidyr, and ggplot2 for analysis. Provides built-in sentiment lexicons and stopword lists, plus functions to convert between tidy formats and document-term matrices from the tm package. Leverages the tokenizers package for flexible tokenization at word, n-gram, sentence, or custom regex levels.

1,200 stars.