Skip to main content

MAX_MOE_TOPK

Constant MAX_MOE_TOPK 

pub const MAX_MOE_TOPK: usize = 16; // 16usize
Expand description

Maximum number of routed experts per token supported on the stack.