Skip to main content

publish_decode_hint

Function publish_decode_hint 

Source
pub fn publish_decode_hint(token_id: u32, step: u32)
Expand description

U0 publishes the active decode position for the U1 producer (non-blocking). Publish a decode-step hint (token id + step) for the speculative-decode consumer.