Skip to main content

Module placement

Module placement 

Source
Expand description

Canonical measured expert placement policy.

Structsยง

ExpertPlacementCalibration
Measured timings used to choose CPU evaluation or a GPU staging transfer.
ExpertPlacementPolicy
Frozen placement policy used for all expert-cache misses in a generation run.