Skip to main content

group_rms_norm_into

Function group_rms_norm_into 

pub fn group_rms_norm_into(
    streams: &[f32],
    stream_count: usize,
    hidden: usize,
    weight: &[f32],
    epsilon: f32,
    out: &mut [f32],
) -> Result<(), QwenNumericError>
Expand description

Normalize each Hyper-Connection stream independently with RMSNorm. The GGUF converter pre-folds the zero-centered (1 + weight) scale into the stored gamma, so the checkpoint bytes multiply directly — callers must not add a further bias (llama.cpp build_hc_mix).