Struct StreamedMoeBuffers
pub struct StreamedMoeBuffers<'a> {
pub raw_row: &'a mut [u8],
pub dequantized_row: &'a mut [f32],
pub router_logits: &'a mut [f32],
pub top_indices: &'a mut [usize; 10],
pub top_logits: &'a mut [f32; 10],
pub top_weights: &'a mut [f32; 10],
pub gate: &'a mut [f32],
pub up: &'a mut [f32],
pub activation: &'a mut [f32],
pub expert_out: &'a mut [f32],
}Fields§
§raw_row: &'a mut [u8]§dequantized_row: &'a mut [f32]§router_logits: &'a mut [f32]§top_indices: &'a mut [usize; 10]§top_logits: &'a mut [f32; 10]§top_weights: &'a mut [f32; 10]§gate: &'a mut [f32]§up: &'a mut [f32]§activation: &'a mut [f32]§expert_out: &'a mut [f32]Auto Trait Implementations§
impl<'a> !UnwindSafe for StreamedMoeBuffers<'a>
impl<'a> Freeze for StreamedMoeBuffers<'a>
impl<'a> RefUnwindSafe for StreamedMoeBuffers<'a>
impl<'a> Send for StreamedMoeBuffers<'a>
impl<'a> Sync for StreamedMoeBuffers<'a>
impl<'a> Unpin for StreamedMoeBuffers<'a>
impl<'a> UnsafeUnpin for StreamedMoeBuffers<'a>
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more