Skip to main content

silu

qualia_core_db::solvers::activation

Function silu 

Source 
pub fn silu(x: &mut [f64])
Expand description

SiLU / Swish: x · σ(x) = x / (1 + e^{-x}), element-wise (Llama/SmolLM2 gate activation).