Skip to main content

apply_q4k_lookup

Function apply_q4k_lookup 

pub fn apply_q4k_lookup(
    operator: &OperatorView<'_>,
    inn: usize,
    out_n: usize,
    input: MatrixView<'_>,
    output: &mut MatrixViewMut<'_>,
    workspace: OperatorWorkspace<'_>,
) -> Result<(), OperatorError>
Expand description

Directly evaluate Q4_K matrix-vector multiplication using activation lookups.