Struct AttentionParams
#[repr(C, align(16))]pub struct AttentionParams {
pub n_embd: u32,
pub n_head: u32,
pub n_kv: u32,
pub head_dim: u32,
pub pos: u32,
pub max_context: u32,
pub layer_stride: u32,
pub slot_kv_elems: u32,
pub scale: f32,
pub rope_theta: f32,
pub rope_scale: f32,
pub kv_quant: u32,
}Expand description
Legacy attention configuration. Use FusedAttentionParams for GPU uniform bindings.
Fields§
§n_embd: u32§n_head: u32§n_kv: u32§head_dim: u32§pos: u32§max_context: u32§layer_stride: u32§slot_kv_elems: u32§scale: f32§rope_theta: f32§rope_scale: f32§kv_quant: u32Trait Implementations§
§impl Clone for AttentionParams
impl Clone for AttentionParams
§fn clone(&self) -> AttentionParams
fn clone(&self) -> AttentionParams
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for AttentionParams
§impl Debug for AttentionParams
impl Debug for AttentionParams
§impl Default for AttentionParams
impl Default for AttentionParams
§fn default() -> AttentionParams
fn default() -> AttentionParams
Returns the “default value” for a type. Read more
§impl PartialEq for AttentionParams
impl PartialEq for AttentionParams
impl Pod for AttentionParams
impl StructuralPartialEq for AttentionParams
Auto Trait Implementations§
impl Freeze for AttentionParams
impl RefUnwindSafe for AttentionParams
impl Send for AttentionParams
impl Sync for AttentionParams
impl Unpin for AttentionParams
impl UnsafeUnpin for AttentionParams
impl UnwindSafe for AttentionParams
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
impl<T> AnyBitPattern for Twhere
T: Pod,
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
§impl<T> CheckedBitPattern for Twhere
T: AnyBitPattern,
impl<T> CheckedBitPattern for Twhere
T: AnyBitPattern,
§type Bits = T
type Bits = T
Self must have the same layout as the specified Bits except for
the possible invalid bit patterns being checked during
is_valid_bit_pattern.§fn is_valid_bit_pattern(_bits: &T) -> bool
fn is_valid_bit_pattern(_bits: &T) -> bool
If this function returns true, then it must be valid to reinterpret
bits
as &Self.Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
impl<T> Interleave for Twhere
T: Pod,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreimpl<T> NoUninit for Twhere
T: Pod,
§impl<T> NoneValue for Twhere
T: Default,
impl<T> NoneValue for Twhere
T: Default,
type NoneType = T
§fn null_value() -> T
fn null_value() -> T
The none-equivalent value.