Struct CircuitBench 

pub struct CircuitBench {
    pub label: String,
    pub kind: CircuitKind,
    pub backend: String,
    pub ms_per_gemv: f64,
    pub gflops: f64,
    pub upload_gbps: f64,
    pub rel_score: f64,
    pub decode_proxy_tok_s: Option<f64>,
}

One benchmarked circuit.

Fields

label: String

kind: CircuitKind

backend: String

ms_per_gemv: f64

Milliseconds per GEMV dispatch (lower is faster).

gflops: f64

Effective GFLOP/s for the GEMV (2·n·n flops / time).

upload_gbps: f64

Host→device upload bandwidth (GB/s) for a representative buffer. The transfer axis (D31): PCIe for a discrete GPU; staging-path for an iGPU (wgpu can’t show true zero-copy → relative signal); f64::INFINITY for the CPU (data is already in its pool — no transfer). Decode that streams weights to a device pays this every token; in-pool compute does not.

rel_score: f64

Relative score in [0,1]: fastest circuit = 1.0, others = fastest_ms / this_ms (or highest decode_proxy_tok_s when decode ranking is active).

decode_proxy_tok_s: Option<f64>

Optional real-decode proxy (tok/s) from a short resident decode on a small model. When present for ≥1 GPU circuit, passport ranking prefers this over GEMV µs.

Trait Implementations

impl Clone for CircuitBench

fn clone(&self) -> CircuitBench

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CircuitBench

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for CircuitBench

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for CircuitBench

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.