pub struct CapabilityMatrix {
pub circuits: Vec<CircuitBench>,
pub gemv_n: usize,
pub npu_probed: bool,
}Expand description
The measured capability matrix — circuits sorted fastest-first. This IS the priority order.
Fields§
§circuits: Vec<CircuitBench>§gemv_n: usize§npu_probed: boolNPU left unprobed (no portable compute path); recorded for honesty.
Implementations§
Source§impl CapabilityMatrix
impl CapabilityMatrix
Sourcepub fn best(&self) -> Option<&CircuitBench>
pub fn best(&self) -> Option<&CircuitBench>
Highest-throughput circuit, if any.
pub fn summary(&self) -> String
Sourcepub fn apply_decode_proxy_ranking(&mut self)
pub fn apply_decode_proxy_ranking(&mut self)
Re-rank circuits: prefer higher decode_proxy_tok_s when present on any GPU row;
otherwise keep GEMV ranking. CPU rows without decode stay at the bottom of GPU ranking.
Trait Implementations§
Source§impl Clone for CapabilityMatrix
impl Clone for CapabilityMatrix
Source§fn clone(&self) -> CapabilityMatrix
fn clone(&self) -> CapabilityMatrix
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for CapabilityMatrix
impl Debug for CapabilityMatrix
Source§impl<'de> Deserialize<'de> for CapabilityMatrix
impl<'de> Deserialize<'de> for CapabilityMatrix
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for CapabilityMatrix
impl RefUnwindSafe for CapabilityMatrix
impl Send for CapabilityMatrix
impl Sync for CapabilityMatrix
impl Unpin for CapabilityMatrix
impl UnsafeUnpin for CapabilityMatrix
impl UnwindSafe for CapabilityMatrix
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more