Skip to main content

Module moe

Module moe 

Expand description

Existing routed-expert math and NVFP4 arithmetic, with caller-owned buffers.

Modulesยง

dispatch
Exact routed/shared NVFP4 dispatch over caller buffers and fixed stack scratch. Inherited shape/panic/partial-state behavior is retained. No callback rollback. Allocation guarantees require a separately qualified nonallocating fetcher.
nvfp4
NVFP4 (E2M1) unpacking and dequantization engine (Work Package F9).
routing
MoE top-k router and gating logic (Work Package F9).