Struct ClusteredMoEOperator
pub struct ClusteredMoEOperator {
pub clusters: Vec<ClusterAnchor>,
}Expand description
Clustered MoE operator holding cluster anchors with shared base projections and per-expert deltas (EOS-071).
Fields§
§clusters: Vec<ClusterAnchor>Implementations§
§impl ClusteredMoEOperator
impl ClusteredMoEOperator
pub fn dispatch(
&self,
routed_experts: &[RoutedExpert],
input: &[f32],
output: &mut [f32],
scratch: &mut ClusteredMoeScratch<'_>,
) -> Result<(), OperatorError>
pub fn dispatch( &self, routed_experts: &[RoutedExpert], input: &[f32], output: &mut [f32], scratch: &mut ClusteredMoeScratch<'_>, ) -> Result<(), OperatorError>
Dispatches.
§impl ClusteredMoEOperator
impl ClusteredMoEOperator
pub fn new(clusters: Vec<ClusterAnchor>) -> ClusteredMoEOperator
pub fn new(clusters: Vec<ClusterAnchor>) -> ClusteredMoEOperator
Creates a default ClusteredMoEOperator.
Trait Implementations§
§impl Clone for ClusteredMoEOperator
impl Clone for ClusteredMoEOperator
§fn clone(&self) -> ClusteredMoEOperator
fn clone(&self) -> ClusteredMoEOperator
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for ClusteredMoEOperator
impl RefUnwindSafe for ClusteredMoEOperator
impl Send for ClusteredMoEOperator
impl Sync for ClusteredMoEOperator
impl Unpin for ClusteredMoEOperator
impl UnsafeUnpin for ClusteredMoEOperator
impl UnwindSafe for ClusteredMoEOperator
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more