Skip to main content

PAGED_GQA_TILED_SRC

Constant PAGED_GQA_TILED_SRC 

pub const PAGED_GQA_TILED_SRC: &'static str;
Expand description

Eight warps score thirty-two context positions per tile (four positions per warp). One online-softmax merge updates value accumulators without an O(context) score buffer.