Skip to main content

combine_expert_outputs

Function combine_expert_outputs 

pub fn combine_expert_outputs(
    expert_outputs: &[&[f32]],
    weights: &[f32],
    hidden_dim: usize,
    out_combined: &mut [f32],
) -> Result<(), MoeError>
Expand description

Combine expert outputs using computed routing weights.

expert_outputs contains k slices of length hidden_dim. weights contains k normalized routing weights. Accumulates weighted sum into out_combined.