Tokenization

textanal:tokenization

Splitting text into words/tokens, the first NLP step.