Reference meaning
tokenize
Last updated
To reduce to a token or set of tokens by lexical analysis.
Other meanings
2. verb
To substitute sensitive data with meaningless placeholders.
3. verb
To treat as a token minority.
Source and scope
This definition is reproduced from English Wiktionary, sense en-tokenize-en-verb-jT9kOSc9, under the CC BY-SA 4.0. It has not yet received VocabularyBase editorial review. Read the source and license details.