Struct ExecutionToggles 

pub struct ExecutionToggles {
    pub kv_int8: bool,
    pub resident_decode: bool,
    pub coop_gemv: bool,
    pub ffn_fusion: bool,
    pub ffn_f16: bool,
    pub ternary_ffn: bool,
}

Runtime knobs that compose with InferenceMode (env-applied at load).

Fields

kv_int8: bool

W5a int8 KV cache (native; ~3.8× less KV BW when on).

resident_decode: bool

Resident mega-pass decode when available.

coop_gemv: bool

Cooperative GEMV.

ffn_fusion: bool

FFN fusion in resident path.

ffn_f16: bool

Promote FFN weights to f16 in VRAM when measuring.

ternary_ffn: bool

Ternary (BitNet-class ~1.58b / ≈1.6 bit/weight) FFN path when container has it.

Trait Implementations

impl Clone for ExecutionToggles

fn clone(&self) -> ExecutionToggles

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ExecutionToggles

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ExecutionToggles

fn default() -> ExecutionToggles

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ExecutionToggles

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for ExecutionToggles

fn eq(&self, other: &ExecutionToggles) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for ExecutionToggles

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ExecutionToggles