Skip to main content

set_spec_decode

qualia_core_db::inference::inference_bench

Function set_spec_decode 

Source 
pub fn set_spec_decode(on: bool)
Expand description

Enable/disable prompt-lookup speculative decode (QUALIA_LLM_SPEC_DECODE). Runtime mode switch — the desktop UI / host calls this to flip between exact single-token decode and speculative decode.