tokenize
/ˈtoʊ.kən.aɪz/
verb 3
Definitions
verb
1
To reduce to a token or set of tokens by lexical analysis.
2
To substitute sensitive data with meaningless placeholders.
3
To treat as a token minority.
Your note
not saved0 chars
verb
To reduce to a token or set of tokens by lexical analysis.
To substitute sensitive data with meaningless placeholders.
To treat as a token minority.