Module moe
Expand description
Existing routed-expert math and NVFP4 arithmetic, with caller-owned buffers.
Modulesยง
- dispatch
- Exact routed/shared NVFP4 dispatch over caller buffers and fixed stack scratch. Inherited shape/panic/partial-state behavior is retained. No callback rollback. Allocation guarantees require a separately qualified nonallocating fetcher.
- nvfp4
- NVFP4 (E2M1) unpacking and dequantization engine (Work Package F9).
- routing
- MoE top-k router and gating logic (Work Package F9).