Skip to main content

set_kv_dict

qualia_core_db::inference::inference_bench

Function set_kv_dict 

Source 
pub fn set_kv_dict(on: bool)
Expand description

Enable/disable the sparse-dictionary KV cache (QUALIA_LLM_KV_DICT).