Skip to main content

gpu_topk_enabled

qualia_core_db::inference::inference_bench

Function gpu_topk_enabled 

Source 
pub fn gpu_topk_enabled() -> bool
Expand description

Whether the GPU top-k decode path is active. The env var overrides the flag in BOTH directions (0/false → off, 1/true → on); otherwise the process default (ON) applies.