pub struct Qwen4ExpNativeRuntime {
pub descriptor: Qwen4ExpNativeDescriptor,
pub index: GgufTensorIndex,
pub ple: PleNvmeReader,
pub trunk: TrunkNvmeReader,
}Expand description
A live package binding. In Streamed residency the file cursors retain
no model data in memory; in Mapped residency the trunk is a read-only
page-cache view. Decoder state and all compute scratch remain caller
owned either way.
Fields§
§descriptor: Qwen4ExpNativeDescriptor§index: GgufTensorIndex§ple: PleNvmeReader§trunk: TrunkNvmeReaderImplementations§
Source§impl Qwen4ExpNativeRuntime
impl Qwen4ExpNativeRuntime
Sourcepub fn activate(package: &Path) -> Result<Self, Qwen4ExpActivationError>
pub fn activate(package: &Path) -> Result<Self, Qwen4ExpActivationError>
Fail-closed cold activation of an HMC package with streamed trunk
reads. The only GGUF read is its metadata prefix (bounded by
MAX_GGUF_HEADER_BYTES).
Sourcepub fn activate_with_residency(
package: &Path,
residency: Qwen4ExpTrunkResidency,
) -> Result<Self, Qwen4ExpActivationError>
pub fn activate_with_residency( package: &Path, residency: Qwen4ExpTrunkResidency, ) -> Result<Self, Qwen4ExpActivationError>
Activation with an explicit trunk residency mode.
Source§impl Qwen4ExpNativeRuntime
impl Qwen4ExpNativeRuntime
pub fn engine(&mut self) -> Qwen4ExpRuntime<'_, GgufHyperparams>
Auto Trait Implementations§
impl Freeze for Qwen4ExpNativeRuntime
impl RefUnwindSafe for Qwen4ExpNativeRuntime
impl Send for Qwen4ExpNativeRuntime
impl Sync for Qwen4ExpNativeRuntime
impl Unpin for Qwen4ExpNativeRuntime
impl UnsafeUnpin for Qwen4ExpNativeRuntime
impl UnwindSafe for Qwen4ExpNativeRuntime
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more