Module kernels
Expand description
Backend-neutral ownership boundary for native paged-attention kernel source.
Constants§
- MAX_
ATTENTION_ SEGMENTS - PAGED_
GQA_ SEGMENTED_ MERGE_ ENTRY - PAGED_
GQA_ SEGMENTED_ PARTIAL_ ENTRY - PAGED_
GQA_ SEGMENTED_ SRC - PAGED_
GQA_ TILED_ ENTRY - PAGED_
GQA_ TILED_ SRC - Eight warps score thirty-two context positions per tile (four positions per warp). One online-softmax merge updates value accumulators without an O(context) score buffer.
Functions§
- segments_
for_ position - Segments for a position.