pub struct HostTopology {
pub adapters: Vec<AdapterDesc>,
pub topology: HostMemoryTopology,
pub host_ram_bytes: u64,
pub host_ram_available_bytes: u64,
pub cpu_cores: usize,
pub os_floor_bytes: u64,
pub usable_model_budget_bytes: u64,
}Expand description
The sensed host: adapters, topology, host memory, and the bounded OS floor (D24).
Fields§
§adapters: Vec<AdapterDesc>§topology: HostMemoryTopology§host_ram_bytes: u64§host_ram_available_bytes: u64§cpu_cores: usize§os_floor_bytes: u64Hard floor reserved for the OS/display (D24): discrete → VRAM display floor; unified → host floor.
usable_model_budget_bytes: u64Best-effort memory the LLM may inhabit after the floor (discrete: VRAM−floor; unified: RAM−floor).
Implementations§
Source§impl HostTopology
impl HostTopology
Sourcepub fn has_heterogeneous_overflow(&self) -> bool
pub fn has_heterogeneous_overflow(&self) -> bool
True when there is both a discrete GPU and a (system-RAM-backed) integrated GPU — the heterogeneous-overflow opportunity (H3): the iGPU can host overflow layers in system RAM.
Trait Implementations§
Source§impl Clone for HostTopology
impl Clone for HostTopology
Source§fn clone(&self) -> HostTopology
fn clone(&self) -> HostTopology
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for HostTopology
impl Debug for HostTopology
Source§impl<'de> Deserialize<'de> for HostTopology
impl<'de> Deserialize<'de> for HostTopology
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for HostTopology
impl RefUnwindSafe for HostTopology
impl Send for HostTopology
impl Sync for HostTopology
impl Unpin for HostTopology
impl UnsafeUnpin for HostTopology
impl UnwindSafe for HostTopology
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more