Expand description
Bounded C:-resident HMC tiles for router-selected Qwen4Exp experts.
A tile contains exactly the gate, up, and down planes for one (layer, expert) pair. Promotion is cold-path, explicit, size-admitted, and never
copies a full GGUF or whole layer to the NVMe cache.
Structs§
Enums§
Constants§
Functions§
- admit_
expert_ tile - Compute the requested tile’s budget admission without creating any files. Existing cache files are only counted when their name carries the dedicated tile suffix; unrelated C: artifacts are never scanned or deleted.
- load_
expert_ tile_ descriptor - Read and validate a compact expert-tile descriptor. Tensor payloads remain in the HMC until a caller explicitly opens that small tile for execution.
- promote_
expert_ tile - Extract one selected expert’s quantized source planes into an HMC tile. The output path must be new. The caller supplies the C: cache directory and budget; this function never evicts or creates an unbounded cache.