Skip to main content

Module dispatch

Module dispatch 

Expand description

Exact routed/shared NVFP4 dispatch over caller buffers and fixed stack scratch. Inherited shape/panic/partial-state behavior is retained. No callback rollback. Allocation guarantees require a separately qualified nonallocating fetcher.

Structs§

ExpertWeightView
Description of one expert’s raw NVFP4 matrices.

Enums§

MoeDispatchError
Nonallocating dispatch errors; host compatibility wrappers may allocate text.

Constants§

MAX_INTERMEDIATE_DIM
MAX_ROUTED_EXPERTS

Functions§

dispatch_moe_step
Dispatch MoE layer step:
evaluate_swiglu_expert_nvfp4
Zero-heap evaluation of one SwiGLU expert: y = (SiLU(x * W_gate) * (x * W_up)) * W_down
silu
SiLU (Swish) activation function: x * sigmoid(x).