Expand description
Canonical measured expert placement policy.
Structsยง
- Expert
Placement Calibration - Measured timings used to choose CPU evaluation or a GPU staging transfer.
- Expert
Placement Policy - Frozen placement policy used for all expert-cache misses in a generation run.