Skip to main content

step_qwen_delta

Function step_qwen_delta 

pub fn step_qwen_delta(
    state: &mut [f32],
    q: &[f32],
    k: &[f32],
    v: &[f32],
    decay: f32,
    beta: f32,
    key_dim: usize,
    value_dim: usize,
    out: &mut [f32],
) -> Result<(), QwenDeltaError>
Expand description

One rectangular head: state[key_lane * value_dim + value_lane]. Q/K are already L2-normalized and Q is already scaled by key_dim^-0.5. Decay and beta are explicit scalars in [0,1]; decay is exp(g), not g. Every slice must have its exact logical length. Any error leaves all buffers unchanged.