Module paged_attention
Expand description
Paged-KV configuration, scalar oracle, and backend kernel sources.
Modules§
- kernels
- Backend-neutral ownership boundary for native paged-attention kernel source.
Structs§
Enums§
Constants§
Functions§
- paged_
gqa_ attention_ into - Scalar oracle for the production paged GQA online-softmax kernel.