Skip to main content

set_resident_weights

qualia_core_db::inference::inference_bench

Function set_resident_weights 

Source 
pub fn set_resident_weights(on: bool)
Expand description

Enable/disable the resident per-tensor weight buffers (QUALIA_LLM_RESIDENT_WEIGHTS).