Skip to main content

QWEN4EXP_QSA_TOP_K

Constant QWEN4EXP_QSA_TOP_K 

pub const QWEN4EXP_QSA_TOP_K: usize = 2048; // 2_048usize
Expand description

Trained indexer budget in TOKENS (qwen4exp.attention.indexer.top_k = 2048): complete four-token blocks compete for TOP_K / COMPRESS_RATIO slots and the members of the still-open trailing group are always visible.