Skip to main content

kv_dict_enabled

qualia_core_db::inference::inference_bench

Function kv_dict_enabled 

Source 
pub fn kv_dict_enabled() -> bool
Expand description

Whether the KV cache should use the installed sparse dictionary.