Skip to main content

constrained_decode

Function constrained_decode 

Source
pub fn constrained_decode(args: &Value, span: Span) -> Result<Value, Diagnostic>
Expand description

Inference.constrained_decode — run DOMINO constrained decoding on a token sequence.

Takes vocab (list of [u32, string] pairs — token ID to byte string), logits (list of f64 — current logit distribution), and optional grammar (string — grammar state name). Returns allowed_tokens (list of u64) and grammar_state (string).