pub struct FtwExpertBankSlice {Show 14 fields
pub shard_idx: usize,
pub component_shards: [usize; 6],
pub gate_up_packed_off: usize,
pub gate_up_packed_len: usize,
pub gate_up_scale_off: usize,
pub gate_up_scale_len: usize,
pub gate_up_global_off: usize,
pub gate_up_global_len: usize,
pub down_packed_off: usize,
pub down_packed_len: usize,
pub down_scale_off: usize,
pub down_scale_len: usize,
pub down_global_off: usize,
pub down_global_len: usize,
}Expand description
Slices within the memory-mapped shards for a single expert in a given layer.
Fields§
§shard_idx: usizeLegacy primary shard (gate/up packed). Components can cross shard boundaries.
component_shards: [usize; 6]gate/up packed, scale, global; down packed, scale, global.
gate_up_packed_off: usize§gate_up_packed_len: usize§gate_up_scale_off: usize§gate_up_scale_len: usize§gate_up_global_off: usize§gate_up_global_len: usize§down_packed_off: usize§down_packed_len: usize§down_scale_off: usize§down_scale_len: usize§down_global_off: usize§down_global_len: usizeTrait Implementations§
Source§impl Clone for FtwExpertBankSlice
impl Clone for FtwExpertBankSlice
impl Copy for FtwExpertBankSlice
Source§impl Debug for FtwExpertBankSlice
impl Debug for FtwExpertBankSlice
Auto Trait Implementations§
impl Freeze for FtwExpertBankSlice
impl RefUnwindSafe for FtwExpertBankSlice
impl Send for FtwExpertBankSlice
impl Sync for FtwExpertBankSlice
impl Unpin for FtwExpertBankSlice
impl UnsafeUnpin for FtwExpertBankSlice
impl UnwindSafe for FtwExpertBankSlice
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> NoneValue for Twhere
T: Default,
impl<T> NoneValue for Twhere
T: Default,
type NoneType = T
§fn null_value() -> T
fn null_value() -> T
The none-equivalent value.