Skip to main content

KV_ATTENTION_MASK_WORDS

qualia_core_db::gguf_bridge

Constant KV_ATTENTION_MASK_WORDS 

Source 
pub const KV_ATTENTION_MASK_WORDS: usize = crate::compute_universe::KV_ATTENTION_MASK_WORDS; // 32usize
Expand description

KV attention bitmask words uploaded to fused_attention.wgsl binding 5.