Skip to main content

Module expert_tile

Module expert_tile 

Source
Expand description

Bounded C:-resident HMC tiles for router-selected Qwen4Exp experts.

A tile contains exactly the gate, up, and down planes for one (layer, expert) pair. Promotion is cold-path, explicit, size-admitted, and never copies a full GGUF or whole layer to the NVMe cache.

Structs§

QwenExpertPlane
QwenExpertTileAdmission
QwenExpertTileDescriptor
QwenExpertTileReader

Enums§

QwenExpertTileError
QwenExpertTilePlaneKind

Constants§

QWEN_EXPERT_TILE_FORMAT
QWEN_EXPERT_TILE_SUFFIX

Functions§

admit_expert_tile
Compute the requested tile’s budget admission without creating any files. Existing cache files are only counted when their name carries the dedicated tile suffix; unrelated C: artifacts are never scanned or deleted.
load_expert_tile_descriptor
Read and validate a compact expert-tile descriptor. Tensor payloads remain in the HMC until a caller explicitly opens that small tile for execution.
promote_expert_tile
Extract one selected expert’s quantized source planes into an HMC tile. The output path must be new. The caller supplies the C: cache directory and budget; this function never evicts or creates an unbounded cache.