Skip to main content

Module kernels

Module kernels 

Expand description

Backend-neutral ownership boundary for native paged-attention kernel source.

Constants§

MAX_ATTENTION_SEGMENTS
PAGED_GQA_SEGMENTED_MERGE_ENTRY
PAGED_GQA_SEGMENTED_PARTIAL_ENTRY
PAGED_GQA_SEGMENTED_SRC
PAGED_GQA_TILED_ENTRY
PAGED_GQA_TILED_SRC
Eight warps score thirty-two context positions per tile (four positions per warp). One online-softmax merge updates value accumulators without an O(context) score buffer.

Functions§

segments_for_position
Segments for a position.