Skip to main content

dequantize_token_embedding_into

Function dequantize_token_embedding_into 

Source
pub fn dequantize_token_embedding_into(
    raw: &[u8],
    tensor: &GgufTensorInfo,
    out: &mut [f32],
) -> Result<usize, ExecutionError>
Expand description

Dequantize a mmap embedding row into caller-supplied out (no heap allocation).