Module numerics
Expand description
Small caller-buffered numerical kernels used by the Qwen4Exp decoder.
These are deliberately independent of storage. A layer executor obtains quantized rows from the C:/E: readers, then applies these deterministic vector kernels without allocating in the decode loop.
Enums§
Functions§
- add_
assign - Add
updateintostatein place, avoiding a temporary residual vector. - add_
into - Copy a supplied vector into an output buffer and add a second vector. This is useful where the decoder must preserve a pre-norm residual separately.
- rms_
norm_ into - Apply Qwen RMSNorm with a separately stored scale vector.