Skip to main content

Module streamed_layer

Module streamed_layer 

Source
Expand description

Compatibility exports for the canonical Etalon Qwen engine.

Structs§

StreamedGdnMoeLayerBuffers
StreamedMoeBuffers
StreamedQsaMoeLayerBuffers
Scratch for the QSA/MoE layer. The QSA state persists across decode tokens while all buffers are caller-owned and reused.

Enums§

StreamedLayerError

Functions§

execute_streamed_gdn_moe_layer
Execute one non-QSA Qwen4Exp layer in trained order: Hyper-Connection mix → GatedDeltaNet → attention inject → Hyper-Connection mix → top-10 routed/shared MoE → FFN inject.
execute_streamed_qsa_moe_layer
Execute one full QSA Qwen4Exp layer in trained order: Hyper-Connection mix → sparse attention → attention inject → Hyper-Connection mix → top-10 routed/shared MoE → FFN inject.