Skip to main content

Module numerics

Module numerics 

Expand description

Small caller-buffered numerical kernels used by the Qwen4Exp decoder.

These are deliberately independent of storage. A layer executor obtains quantized rows from the C:/E: readers, then applies these deterministic vector kernels without allocating in the decode loop.

Enums§

QwenNumericError

Functions§

add_assign
Add update into state in place, avoiding a temporary residual vector.
add_into
Copy a supplied vector into an output buffer and add a second vector. This is useful where the decoder must preserve a pre-norm residual separately.
rms_norm_into
Apply Qwen RMSNorm with a separately stored scale vector.