Skip to main content

ternary_eligible

Function ternary_eligible 

Source
pub fn ternary_eligible(role: u16) -> bool
Expand description

The §A ternary policy: only the FFN projection weights (gate / up / down) are eligible for BitNet-1.58b ternary packing. Attention projections, norms, and embeddings stay at higher fidelity — ternarising them destroys coherence.