Struct ClusterAnchor
pub struct ClusterAnchor {
pub cluster_id: usize,
pub model_dim: usize,
pub hidden_dim: usize,
pub base_gate: Vec<u8>,
pub base_up: Vec<u8>,
pub base_down: Vec<u8>,
pub expert_ids: Vec<usize>,
pub expert_gate_deltas: Vec<Option<LowRankDelta>>,
pub expert_up_deltas: Vec<Option<LowRankDelta>>,
pub expert_down_deltas: Vec<Option<LowRankDelta>>,
}Expand description
A cluster anchor containing shared base weights and per-expert deltas (EOS-071).
Fields§
§cluster_id: usize§model_dim: usize§base_gate: Vec<u8>§base_up: Vec<u8>§base_down: Vec<u8>§expert_ids: Vec<usize>§expert_gate_deltas: Vec<Option<LowRankDelta>>Optional low-rank deltas for each expert: (expert_id -> deltas)
expert_up_deltas: Vec<Option<LowRankDelta>>§expert_down_deltas: Vec<Option<LowRankDelta>>Trait Implementations§
§impl Clone for ClusterAnchor
impl Clone for ClusterAnchor
§fn clone(&self) -> ClusterAnchor
fn clone(&self) -> ClusterAnchor
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for ClusterAnchor
impl RefUnwindSafe for ClusterAnchor
impl Send for ClusterAnchor
impl Sync for ClusterAnchor
impl Unpin for ClusterAnchor
impl UnsafeUnpin for ClusterAnchor
impl UnwindSafe for ClusterAnchor
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more