Detokenizer

Detokenize parallel texts.

Parameters:

• tokenizer: tokenizer type or a list of types for each input

• languages: a list of language codes for each input

• options: tokenizer options dictionary or a list of tokenizer dictionaries for multiple tokenziers (optional)

See Tokenizer for description of the parameters.