Struct BenchResultSerde
pub struct BenchResultSerde {Show 15 fields
pub label: String,
pub quantization: String,
pub prompt_tokens: u64,
pub output_tokens: u64,
pub cold_ttft_ms: f64,
pub cold_total_ms: f64,
pub warm_ttft_ms: f64,
pub warm_total_ms: f64,
pub load_ms: f64,
pub prefill_ms: f64,
pub prefill_tok_s: f64,
pub decode_ms: f64,
pub decode_tok_s: f64,
pub mapped_bytes: u64,
pub kv_cache_bytes: u64,
}Expand description
Serializable subset of BenchResult (the original only derives Serialize).
Fields§
§label: String§quantization: String§prompt_tokens: u64§output_tokens: u64§cold_ttft_ms: f64§cold_total_ms: f64§warm_ttft_ms: f64§warm_total_ms: f64§load_ms: f64§prefill_ms: f64§prefill_tok_s: f64§decode_ms: f64§decode_tok_s: f64§mapped_bytes: u64§kv_cache_bytes: u64Trait Implementations§
§impl Clone for BenchResultSerde
impl Clone for BenchResultSerde
§fn clone(&self) -> BenchResultSerde
fn clone(&self) -> BenchResultSerde
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read more§impl Debug for BenchResultSerde
impl Debug for BenchResultSerde
§impl Default for BenchResultSerde
impl Default for BenchResultSerde
§fn default() -> BenchResultSerde
fn default() -> BenchResultSerde
Returns the “default value” for a type. Read more
§impl<'de> Deserialize<'de> for BenchResultSerde
impl<'de> Deserialize<'de> for BenchResultSerde
§fn deserialize<__D>(
__deserializer: __D,
) -> Result<BenchResultSerde, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<BenchResultSerde, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl From<&BenchResult> for BenchResultSerde
impl From<&BenchResult> for BenchResultSerde
Source§fn from(value: &BenchResult) -> Self
fn from(value: &BenchResult) -> Self
Converts to this type from the input type.
§impl Serialize for BenchResultSerde
impl Serialize for BenchResultSerde
§fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
Serialize this value into the given Serde serializer. Read more
Auto Trait Implementations§
impl Freeze for BenchResultSerde
impl RefUnwindSafe for BenchResultSerde
impl Send for BenchResultSerde
impl Sync for BenchResultSerde
impl Unpin for BenchResultSerde
impl UnsafeUnpin for BenchResultSerde
impl UnwindSafe for BenchResultSerde
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> NoneValue for Twhere
T: Default,
impl<T> NoneValue for Twhere
T: Default,
type NoneType = T
§fn null_value() -> T
fn null_value() -> T
The none-equivalent value.