mstar.model.components.distributed.sequence\_parallel
=====================================================

.. automodule:: mstar.model.components.distributed.sequence_parallel

   
   
   

   
   
   .. rubric:: Functions

   .. autosummary::
   
      gather_sequence
      scatter_sequence
      sp_head_gather
      sp_head_slice
      sp_seq_split
      ulysses_attention