Struct ExpertResidencyProfile
pub struct ExpertResidencyProfile {
pub available_accelerator_bytes: u64,
pub backbone_bytes: u64,
pub kv_cache_bytes: u64,
pub bytes_per_expert: usize,
pub total_experts: usize,
pub is_unified_memory: bool,
}Expand description
Cold-path memory observation bound to a model activation.
available_accelerator_bytes is the measured free budget after other processes and the
runtime safety reserve; it is deliberately not a nominal adapter-VRAM claim.
Fields§
§available_accelerator_bytes: u64§backbone_bytes: u64§kv_cache_bytes: u64§bytes_per_expert: usize§total_experts: usize§is_unified_memory: boolImplementations§
§impl ExpertResidencyProfile
impl ExpertResidencyProfile
pub fn placement(self) -> (usize, PersonalHardwareTier)
pub fn placement(self) -> (usize, PersonalHardwareTier)
Placement and hardware tier.
Trait Implementations§
§impl Clone for ExpertResidencyProfile
impl Clone for ExpertResidencyProfile
§fn clone(&self) -> ExpertResidencyProfile
fn clone(&self) -> ExpertResidencyProfile
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for ExpertResidencyProfile
§impl Debug for ExpertResidencyProfile
impl Debug for ExpertResidencyProfile
impl Eq for ExpertResidencyProfile
§impl PartialEq for ExpertResidencyProfile
impl PartialEq for ExpertResidencyProfile
impl StructuralPartialEq for ExpertResidencyProfile
Auto Trait Implementations§
impl Freeze for ExpertResidencyProfile
impl RefUnwindSafe for ExpertResidencyProfile
impl Send for ExpertResidencyProfile
impl Sync for ExpertResidencyProfile
impl Unpin for ExpertResidencyProfile
impl UnsafeUnpin for ExpertResidencyProfile
impl UnwindSafe for ExpertResidencyProfile
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more