Skip to main content

execute_streamed_hyper_connection

Function execute_streamed_hyper_connection 

pub fn execute_streamed_hyper_connection(
    trunk: &mut TrunkNvmeReader,
    layer: &LayerTensors,
    ffn: bool,
    residual: &[f32],
    mixed: &mut [f32],
    inject: Option<&mut [f32]>,
    buffers: &mut StreamedHyperBuffers<'_>,
) -> Result<(), StreamedHyperError>
Expand description

Stream one attention or FFN Hyper-Connection mix from the trunk.