mstar.engine.resources.kv

mstar.engine.resources.kv#

Modules

cache

config

What a model declares about a KV cache: its shape, its spec, its step.

cpu_page_pool

Host-side page pool for KV cache offloading.

keys

Page keys for cross-request prefix reuse.

manager

plan

The KV plan: what KVManager.plan hands its dependents.

prefix_index

The prefix index: which cached page holds which key, and which to drop first.

ring

Ring KV storage: a fixed horizon of frame slots, overwritten in place.

transfer

KV transfer: moving one request's pages between engines.