mstar.engine.resources.spec

Resource declarations models hand to the engine.

The engine builds each node’s resources once, at load time, from these specs. A spec names what to build and its parameters; the model declares, the engine constructs. The default declaration wraps a model’s KV cache configs unchanged, so a model only overrides it to add resources beyond what those configs already describe.

Functions

apply_yaml_overrides(specs, model_config)	Apply a deployment's resources: block to the specs it names.
resolve_spec_dependencies(specs)	Index specs by resource key, checking uniqueness and depends_on.
spec_dependency_problems(specs)	Every duplicate resource key and undeclared depends_on in specs.
unknown_overrides_message(unknown, declared)

Classes

CombinedSplit(combined_walk, prefill_walks)	A combined walk run on two kernels: decode for one-token rows, prefill for the rows of prefill_walks, captured for as many as max_rows_in_combined lets in (an uncapped walk: the bucket's rows).
NodeResourceSpec(resource_key, nodes)
ResourceReqConfig()	Per-request parameters for one resource, carried on the request and handed to that resource at ingest.

class mstar.engine.resources.spec.CombinedSplit(combined_walk, prefill_walks)

Bases: object

A combined walk run on two kernels: decode for one-token rows, prefill for the rows of prefill_walks, captured for as many as max_rows_in_combined lets in (an uncapped walk: the bucket’s rows).

Parameters:

• combined_walk (str)

• prefill_walks (tuple[str, ...])

combined_walk: str

max_prefill_rows(max_rows_in_combined, bucket_rows)

Parameters:

• max_rows_in_combined (Mapping[str, int | None])

• bucket_rows (int)

Return type:

int

prefill_walks: tuple[str, ...]

class mstar.engine.resources.spec.NodeResourceSpec(resource_key: str, nodes: set[str])

Bases: ABC

Parameters:

• resource_key (str)

• nodes (set[str])

apply_yaml_overrides(**kwargs)

Patch declared parameters from this resource’s YAML block.

The model declares shapes that suit the model; a deployment tunes what suits the box it runs on. The block is scoped to this spec’s resource_key (see apply_yaml_overrides below), so an unrecognized key here is a typo, not another resource’s setting — subclasses name exactly what they accept and let the rest raise.

TODO: generalize. Matching YAML keys against the spec’s (and its config’s) dataclass fields would remove these per-resource implementations, at the cost of silently accepting anything named alike.

depends_on()

Keys whose specs this one builds against; the engine resolves them into EngineResourceInfo.dependencies.

Return type:

set[str]

nodes: set[str]

abstract property resource_class: type[Resource]

What builds this spec. Imported inside the property, so declaring a resource stays free of the manager and its kernels.

The builder, not necessarily the class built: an attention spec names AttentionManager, whose build picks a backend subclass.

resource_key: str

class mstar.engine.resources.spec.ResourceReqConfig

Bases: object

Per-request parameters for one resource, carried on the request and handed to that resource at ingest. Keyed by resource key, so it needs no tag of its own — a marker base, with no contract beyond the hooks below.

apply_conductor_config(**kwargs)

loop_room(spec=None)

The most iterations each loop can run before the request outgrows the resource built from spec. A loop the resource doesn’t bound is left out.

Parameters:

spec (NodeResourceSpec | None)

Return type:

dict[str, int]

validate(spec=None)

Raise ValueError if a client-supplied value is out of range, or one the resource built from spec cannot honour.

The conductor calls it at admission, so a bad request is a 400 before any worker sees it.

Parameters:

spec (NodeResourceSpec | None)

Return type:

None

mstar.engine.resources.spec.apply_yaml_overrides(specs, model_config)

Apply a deployment’s resources: block to the specs it names.

resources: {<resource_key>: {...}}, one block per resource, so a model with two pools of the same kind (whisper’s decoder cache and its encoder context) can have each tuned on its own. An unknown key is an error: it would otherwise be a silently ineffective setting.

Parameters:

• specs (Sequence[NodeResourceSpec])

• model_config (Mapping[str, Any])

Return type:

None

mstar.engine.resources.spec.resolve_spec_dependencies(specs)

Index specs by resource key, checking uniqueness and depends_on.

Parameters:

specs (Sequence[NodeResourceSpec])

Return type:

dict[str, NodeResourceSpec]

mstar.engine.resources.spec.spec_dependency_problems(specs)

Every duplicate resource key and undeclared depends_on in specs.

Parameters:

specs (Sequence[NodeResourceSpec])

Return type:

list[str]

mstar.engine.resources.spec.unknown_overrides_message(unknown, declared)

Parameters:

• unknown (list[str])

• declared (Collection[str])

Return type:

str