The token list is similar to the character list but displays tokens instead of characters. The tokenization of the characters is applied when using 'string edit distance - tokenized' as type of processing. There is a preprocessing step taking place, where each unique combination of vowel or consonant and the following diacritics are combined into a single unique token.