mstar.engine.resources.attn.ragged.base#
The cacheless attention resource: the spec-time factory.
Sibling of attn.base’s AttentionManager, for attention that is not
backed by a KV cache, e.g., an encoder tower attending within variable-length
segments of one packed forward. There is nothing to page, nothing to advance,
and nothing to carry between steps: the resource holds only planned wrappers.
Classes
- class mstar.engine.resources.attn.ragged.base.RaggedAttnManager[source]#
Bases:
AttentionResource- classmethod build(spec, info)[source]#
- Parameters:
spec (RaggedAttentionSpec)
info (EngineResourceInfo)