Skip to main content

decode_attn_ffn

qualia_core_db::inference::inference_bench

Function decode_attn_ffn 

Source 
pub fn decode_attn_ffn() -> (u64, u64)
Expand description

Read the intra-layer attention/FFN accumulators as (attn_ns, ffn_ns) (summed over the run).