Home > Term: Tokenizer
Tokenizer
A text segmentation programme that scans text and determines if and when a series of characters can be recognised as a token.
- Del af tale: noun
- Branche/domæne: Software
- Category: Globalization software service
- Company: IBM
0
Ophavsmand
- Harry8L
-
(V.I.P) 574128 points - 100% positive feedback
(London, United Kingdom)
