Skip to main content

Module dispatch

Module dispatch 

Source
Expand description

Compatibility adapter for the canonical Etalon routed-expert dispatcher.

Structs§

ExpertWeightView
Description of one expert’s raw NVFP4 matrices.

Constants§

MAX_INTERMEDIATE_DIM
MAX_ROUTED_EXPERTS

Functions§

dispatch_moe_step
evaluate_swiglu_expert_nvfp4
Zero-heap evaluation of one SwiGLU expert: y = (SiLU(x * W_gate) * (x * W_up)) * W_down
silu
SiLU (Swish) activation function: x * sigmoid(x).