Module dispatch
Expand description
Exact routed/shared NVFP4 dispatch over caller buffers and fixed stack scratch. Inherited shape/panic/partial-state behavior is retained. No callback rollback. Allocation guarantees require a separately qualified nonallocating fetcher.
Structs§
- Expert
Weight View - Description of one expert’s raw NVFP4 matrices.
Enums§
- MoeDispatch
Error - Nonallocating dispatch errors; host compatibility wrappers may allocate text.
Constants§
Functions§
- dispatch_
moe_ step - Dispatch MoE layer step:
- evaluate_
swiglu_ expert_ nvfp4 - Zero-heap evaluation of one SwiGLU expert: y = (SiLU(x * W_gate) * (x * W_up)) * W_down
- silu
- SiLU (Swish) activation function: x * sigmoid(x).