Enum LlmWorkloadPhase
#[repr(u8)]pub enum LlmWorkloadPhase {
Idle = 0,
PromptProcessing = 1,
ActiveDecode = 2,
}Expand description
Execution state of the concurrent local LLM inference engine.
Variants§
Idle = 0
LLM is loaded in mmap cache, but no active generation or prompt ingestion is occurring.
PromptProcessing = 1
LLM is ingesting prompt tokens: high compute saturation and memory bandwidth.
ActiveDecode = 2
LLM is actively generating tokens autoregressively (e.g. 30–60 tok/s).
Trait Implementations§
§impl Clone for LlmWorkloadPhase
impl Clone for LlmWorkloadPhase
§fn clone(&self) -> LlmWorkloadPhase
fn clone(&self) -> LlmWorkloadPhase
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for LlmWorkloadPhase
§impl Debug for LlmWorkloadPhase
impl Debug for LlmWorkloadPhase
§impl<'de> Deserialize<'de> for LlmWorkloadPhase
impl<'de> Deserialize<'de> for LlmWorkloadPhase
§fn deserialize<__D>(
__deserializer: __D,
) -> Result<LlmWorkloadPhase, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<LlmWorkloadPhase, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for LlmWorkloadPhase
§impl PartialEq for LlmWorkloadPhase
impl PartialEq for LlmWorkloadPhase
§impl Serialize for LlmWorkloadPhase
impl Serialize for LlmWorkloadPhase
§fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
Serialize this value into the given Serde serializer. Read more
impl StructuralPartialEq for LlmWorkloadPhase
Auto Trait Implementations§
impl Freeze for LlmWorkloadPhase
impl RefUnwindSafe for LlmWorkloadPhase
impl Send for LlmWorkloadPhase
impl Sync for LlmWorkloadPhase
impl Unpin for LlmWorkloadPhase
impl UnsafeUnpin for LlmWorkloadPhase
impl UnwindSafe for LlmWorkloadPhase
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more