Skip to main content

execute_streamed_qsa

Function execute_streamed_qsa 

pub fn execute_streamed_qsa(
    trunk: &mut TrunkNvmeReader,
    layer: &LayerTensors,
    input: &[f32],
    state: &mut QsaState<'_>,
    rope_theta: f32,
    out: &mut [f32],
    buffers: &mut StreamedQsaBuffers<'_>,
) -> Result<(), StreamedQsaError>
Expand description

Execute one causal QSA decode step. rope_theta is explicit so the bounded operator cannot silently invent a positional encoding policy; the Qwen4Exp runtime passes the GGUF model value (10,000,000 for this model).