Skip to main content

inject_stream_update

Function inject_stream_update 

pub fn inject_stream_update(
    streams: &mut [f32],
    update: &[f32],
    inject_gate: &[f32],
    stream_count: usize,
    hidden: usize,
) -> Result<(), QwenNumericError>
Expand description

Add a block update into each Hyper stream. inject_gate is the sigmoid output of the streamed HC inject projection; Qwen scales it by two.