Skip to main content

set_gpu_topk

qualia_core_db::inference::inference_bench

Function set_gpu_topk 

Source 
pub fn set_gpu_topk(on: bool)
Expand description

Enable/disable the GPU top-k decode path (QUALIA_LLM_GPU_TOPK).