Struct FfnBlockWeights
pub struct FfnBlockWeights {
pub model_dim: usize,
pub hidden_dim: usize,
pub gate_bytes: Vec<u8>,
pub up_bytes: Vec<u8>,
pub down_bytes: Vec<u8>,
}Expand description
SwiGLU FFN block weights in packed GGML Q4_K format.
Fields§
§model_dim: usize§gate_bytes: Vec<u8>§up_bytes: Vec<u8>§down_bytes: Vec<u8>Implementations§
§impl FfnBlockWeights
impl FfnBlockWeights
pub fn new_synthetic(model_dim: usize, hidden_dim: usize) -> FfnBlockWeights
pub fn new_synthetic(model_dim: usize, hidden_dim: usize) -> FfnBlockWeights
Create synthetic Q4_K weights for a SwiGLU FFN block.
Auto Trait Implementations§
impl Freeze for FfnBlockWeights
impl RefUnwindSafe for FfnBlockWeights
impl Send for FfnBlockWeights
impl Sync for FfnBlockWeights
impl Unpin for FfnBlockWeights
impl UnsafeUnpin for FfnBlockWeights
impl UnwindSafe for FfnBlockWeights
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more