Skip to main content

ARCH_QWEN35_MOE

Constant ARCH_QWEN35_MOE 

pub const ARCH_QWEN35_MOE: u32 = 10; // 10u32
Expand description

Qwen 3.5/3.6 MoE: hybrid SSM + periodic full attention, with fused QKV.