Constant DEFAULT_GPU_EXPERT_SLOTS
pub const DEFAULT_GPU_EXPERT_SLOTS: usize = 32; // 32usizeExpand description
Maximum number of active expert slots in GPU VRAM simultaneously.
pub const DEFAULT_GPU_EXPERT_SLOTS: usize = 32; // 32usizeMaximum number of active expert slots in GPU VRAM simultaneously.