mstar.conductor

mstar.conductor#

Modules

mps

CUDA MPS for a deployment that runs several workers on one GPU (mps: true).

request_info

workers

The workers a deployment config starts, and the device each runs on.