Tokenization

ling:concept:tokenization

Splitting text into words or sub-word units — the first step of language processing.