pub enum QuantizationScheme {
SymmetricInt8,
}Expand description
Model-agnostic post-training quantization schemes.
The compressed payload is intentionally just a caller-owned byte slice plus these scalar parameters; it is not tied to GGUF or any framework container.
Variants§
SymmetricInt8
Per-tensor signed int8 quantization with a zero point of zero.
Trait Implementations§
Source§impl Clone for QuantizationScheme
impl Clone for QuantizationScheme
Source§fn clone(&self) -> QuantizationScheme
fn clone(&self) -> QuantizationScheme
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for QuantizationScheme
impl Debug for QuantizationScheme
Source§impl<'de> Deserialize<'de> for QuantizationScheme
impl<'de> Deserialize<'de> for QuantizationScheme
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for QuantizationScheme
impl PartialEq for QuantizationScheme
Source§fn eq(&self, other: &QuantizationScheme) -> bool
fn eq(&self, other: &QuantizationScheme) -> bool
Tests for
self and other values to be equal, and is used by ==.Source§impl Serialize for QuantizationScheme
impl Serialize for QuantizationScheme
impl Copy for QuantizationScheme
impl Eq for QuantizationScheme
impl StructuralPartialEq for QuantizationScheme
Auto Trait Implementations§
impl Freeze for QuantizationScheme
impl RefUnwindSafe for QuantizationScheme
impl Send for QuantizationScheme
impl Sync for QuantizationScheme
impl Unpin for QuantizationScheme
impl UnsafeUnpin for QuantizationScheme
impl UnwindSafe for QuantizationScheme
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more