Struct GatedDeltaBuffers
pub struct GatedDeltaBuffers<'a> {
pub raw_row: &'a mut [u8],
pub projection_row: &'a mut [f32],
pub qkv: &'a mut [f32],
pub gate: &'a mut [f32],
pub alpha: &'a mut [f32],
pub beta: &'a mut [f32],
pub convolved: &'a mut [f32],
pub head_norm: &'a mut [f32],
pub head_vector: &'a mut [f32],
pub output_inner: &'a mut [f32],
pub head_a: &'a mut [f32],
pub dt_bias: &'a mut [f32],
}Expand description
Scratch buffers reused for every GatedDeltaNet decode step.
Fields§
§raw_row: &'a mut [u8]§projection_row: &'a mut [f32]Must hold the widest source tensor row (the 6,144-wide output input).
qkv: &'a mut [f32]§gate: &'a mut [f32]§alpha: &'a mut [f32]§beta: &'a mut [f32]§convolved: &'a mut [f32]§head_norm: &'a mut [f32]§head_vector: &'a mut [f32]§output_inner: &'a mut [f32]§head_a: &'a mut [f32]§dt_bias: &'a mut [f32]Auto Trait Implementations§
impl<'a> !UnwindSafe for GatedDeltaBuffers<'a>
impl<'a> Freeze for GatedDeltaBuffers<'a>
impl<'a> RefUnwindSafe for GatedDeltaBuffers<'a>
impl<'a> Send for GatedDeltaBuffers<'a>
impl<'a> Sync for GatedDeltaBuffers<'a>
impl<'a> Unpin for GatedDeltaBuffers<'a>
impl<'a> UnsafeUnpin for GatedDeltaBuffers<'a>
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more