pub enum Qwen4ExpTrunkResidency {
Streamed,
Mapped,
}Expand description
How the trunk weights are reached during decode.
Variants§
Streamed
Seek+read each row span from disk; steady-state memory stays bounded.
Mapped
Read-only mmap of the source GGUF; the OS page cache holds the trunk in RAM and row access is a pointer slice. This deliberately trades the bounded-memory guarantee for speed on machines whose RAM fits the trunk (the intended deployment: trunk in RAM, PLE on NVMe).
Trait Implementations§
Source§impl Clone for Qwen4ExpTrunkResidency
impl Clone for Qwen4ExpTrunkResidency
impl Copy for Qwen4ExpTrunkResidency
Source§impl Debug for Qwen4ExpTrunkResidency
impl Debug for Qwen4ExpTrunkResidency
Source§impl Default for Qwen4ExpTrunkResidency
impl Default for Qwen4ExpTrunkResidency
impl Eq for Qwen4ExpTrunkResidency
Source§impl PartialEq for Qwen4ExpTrunkResidency
impl PartialEq for Qwen4ExpTrunkResidency
impl StructuralPartialEq for Qwen4ExpTrunkResidency
Auto Trait Implementations§
impl Freeze for Qwen4ExpTrunkResidency
impl RefUnwindSafe for Qwen4ExpTrunkResidency
impl Send for Qwen4ExpTrunkResidency
impl Sync for Qwen4ExpTrunkResidency
impl Unpin for Qwen4ExpTrunkResidency
impl UnsafeUnpin for Qwen4ExpTrunkResidency
impl UnwindSafe for Qwen4ExpTrunkResidency
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> NoneValue for Twhere
T: Default,
impl<T> NoneValue for Twhere
T: Default,
type NoneType = T
§fn null_value() -> T
fn null_value() -> T
The none-equivalent value.