Skip to main content

set_resident_prefill

qualia_core_db::inference::inference_bench

Function set_resident_prefill 

Source 
pub fn set_resident_prefill(on: bool)
Expand description

Enable/disable the resident single-fence-per-chunk prefill path (QUALIA_LLM_RESIDENT_PREFILL).