Module qwen_delta
Expand description
Explicit Qwen decay-before-prediction recurrence, independent of the legacy API.
Enums§
Functions§
- step_
qwen_ delta - One rectangular head:
state[key_lane * value_dim + value_lane]. Q/K are already L2-normalized and Q is already scaled bykey_dim^-0.5. Decay and beta are explicit scalars in [0,1]; decay isexp(g), notg. Every slice must have its exact logical length. Any error leaves all buffers unchanged.