Skip to main content

quantize_ternary

Function quantize_ternary 

Source
pub fn quantize_ternary(weights: &[f32]) -> (f32, Vec<i8>)
Expand description

BitNet 1.58b quantize: per-tensor absmean scale + ternary values ∈ {-1,0,+1}. A zero (or empty) tensor yields scale = 0.0 and all-zero trits.