Skip to main content

Module paged_attention

Module paged_attention 

Expand description

Paged-KV configuration, scalar oracle, and backend kernel sources.

Modules§

kernels
Backend-neutral ownership boundary for native paged-attention kernel source.

Structs§

PagedKvConfig

Enums§

AttentionError

Constants§

DEFAULT_BLOCK_SIZE
INVALID_BLOCK

Functions§

paged_gqa_attention_into
Scalar oracle for the production paged GQA online-softmax kernel.