Skip to main content

Module streamed_hyper

Module streamed_hyper 

Source
Expand description

Compatibility exports for the canonical Etalon Qwen engine.

Structs§

StreamedHyperBuffers

Enums§

StreamedHyperError

Functions§

execute_streamed_final_hyper_connection
Execute Qwen4Exp’s final global Hyper-Connection mixer. Unlike a layer mixer it has no injection projection: the collapsed hidden vector feeds the vocabulary projection directly in place of an output_norm tensor.
execute_streamed_hyper_connection
Stream one attention or FFN Hyper-Connection mix from the trunk.
inject_hyper_update
Scatter a token-mixer/MoE branch back into each residual stream. Qwen4Exp uses one learned inject scalar per stream, divided by the stream count.
mix_hyper_streams
Form the hidden-width mixer input from the learned per-stream gates.