Struct PhaseSnapshotSerde
pub struct PhaseSnapshotSerde {
pub load_ns: u64,
pub prefill_ns: u64,
pub prefill_tokens: u64,
pub decode_ns: u64,
pub decode_tokens: u64,
pub decode_forward_ns: u64,
pub decode_output_ns: u64,
}Expand description
Serializable phase snapshot (the atomic counters are copied into plain u64s).
Fields§
§load_ns: u64§prefill_ns: u64§prefill_tokens: u64§decode_ns: u64§decode_tokens: u64§decode_forward_ns: u64§decode_output_ns: u64Trait Implementations§
§impl Clone for PhaseSnapshotSerde
impl Clone for PhaseSnapshotSerde
§fn clone(&self) -> PhaseSnapshotSerde
fn clone(&self) -> PhaseSnapshotSerde
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for PhaseSnapshotSerde
§impl Debug for PhaseSnapshotSerde
impl Debug for PhaseSnapshotSerde
§impl Default for PhaseSnapshotSerde
impl Default for PhaseSnapshotSerde
§fn default() -> PhaseSnapshotSerde
fn default() -> PhaseSnapshotSerde
Returns the “default value” for a type. Read more
§impl<'de> Deserialize<'de> for PhaseSnapshotSerde
impl<'de> Deserialize<'de> for PhaseSnapshotSerde
§fn deserialize<__D>(
__deserializer: __D,
) -> Result<PhaseSnapshotSerde, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<PhaseSnapshotSerde, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl From<LlmPhaseSnapshot> for PhaseSnapshotSerde
impl From<LlmPhaseSnapshot> for PhaseSnapshotSerde
Source§fn from(value: LlmPhaseSnapshot) -> Self
fn from(value: LlmPhaseSnapshot) -> Self
Converts to this type from the input type.
§impl Serialize for PhaseSnapshotSerde
impl Serialize for PhaseSnapshotSerde
§fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
Serialize this value into the given Serde serializer. Read more
Auto Trait Implementations§
impl Freeze for PhaseSnapshotSerde
impl RefUnwindSafe for PhaseSnapshotSerde
impl Send for PhaseSnapshotSerde
impl Sync for PhaseSnapshotSerde
impl Unpin for PhaseSnapshotSerde
impl UnsafeUnpin for PhaseSnapshotSerde
impl UnwindSafe for PhaseSnapshotSerde
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> NoneValue for Twhere
T: Default,
impl<T> NoneValue for Twhere
T: Default,
type NoneType = T
§fn null_value() -> T
fn null_value() -> T
The none-equivalent value.