Watch a tokenizer chop sentences into pieces on a conveyor. The same greeting costs far more tokens in Yoruba than in English. See why, and type your own. This lesson needs JavaScript.