Skip to main content

execute_streamed_moe

Function execute_streamed_moe 

pub fn execute_streamed_moe(
    reader: &mut TrunkNvmeReader,
    tensors: &LayerTensors,
    input: &[f32],
    out: &mut [f32],
    router_logits: &mut [f32],
    top_indices: &mut [usize; 10],
    top_logits: &mut [f32; 10],
    top_weights: &mut [f32; 10],
    gate: &mut [f32],
    up: &mut [f32],
    activation: &mut [f32],
    expert_out: &mut [f32],
    raw_row: &mut [u8],
    dequantized_row: &mut [f32],
) -> Result<(), StreamedMoeError>
Expand description

Source-only compatibility path. New native callers should use [execute_streamed_moe_with_tiles] to supply any validated C: tiles.