Skip to main content

Module session

Module session 

Source
Expand description

Caller-budgeted cold state and allocation-free mixed-attention token execution. A token commits only after every layer, final norm, and output projection.

Structs§

Session

Enums§

SessionError