mstar.model.omnilingual\_asr.tokenizer
======================================

.. automodule:: mstar.model.omnilingual_asr.tokenizer

   
   
   

   
   
   .. rubric:: Functions

   .. autosummary::
   
      ctc_collapse
      ctc_greedy_ids
      read_sentencepiece_pieces
   
   

   
   
   .. rubric:: Classes

   .. autosummary::
   
      CharTokenizer