#[repr(u8)]pub enum InferenceMode {
Portable = 0,
CudaTc = 1,
QuantGraph = 2,
FastVerify = 3,
}Expand description
Active inference approach for this process.
Variants§
Portable = 0
wgpu single-fence resident decode/prefill — default, portable.
CudaTc = 1
Prefer CUDA tensor-core dense GEMM via forge when eligible; else Portable.
QuantGraph = 2
Quantized front-end + graph/Webizen grounding for quality recovery.
FastVerify = 3
Full-speed decode (skip mid-token Sentinel rings) then post-turn verify/heal.
Implementations§
Trait Implementations§
Source§impl Clone for InferenceMode
impl Clone for InferenceMode
Source§impl ConfigApplier for InferenceMode
impl ConfigApplier for InferenceMode
fn apply_config(config: &LabConfig)
impl Copy for InferenceMode
Source§impl Debug for InferenceMode
impl Debug for InferenceMode
impl Eq for InferenceMode
Source§impl Hash for InferenceMode
impl Hash for InferenceMode
Source§impl LabMode for InferenceMode
impl LabMode for InferenceMode
Source§impl PartialEq for InferenceMode
impl PartialEq for InferenceMode
impl StructuralPartialEq for InferenceMode
Auto Trait Implementations§
impl Freeze for InferenceMode
impl RefUnwindSafe for InferenceMode
impl Send for InferenceMode
impl Sync for InferenceMode
impl Unpin for InferenceMode
impl UnsafeUnpin for InferenceMode
impl UnwindSafe for InferenceMode
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more