Struct ExpertWeightView
pub struct ExpertWeightView<'a> {
pub gate_up_packed: &'a [u8],
pub gate_up_scale: &'a [u8],
pub gate_up_global: f32,
pub down_packed: &'a [u8],
pub down_scale: &'a [u8],
pub down_global: f32,
pub intermediate_dim: usize,
pub emb_dim: usize,
}Expand description
Description of one expert’s raw NVFP4 matrices.
Fields§
§gate_up_packed: &'a [u8]Gate + Up packed matrix (NVFP4, 2 nibbles per byte)
gate_up_scale: &'a [u8]Per-16 FP8 block scales
gate_up_global: f32§down_packed: &'a [u8]Down packed matrix (NVFP4)
down_scale: &'a [u8]§down_global: f32§intermediate_dim: usize§emb_dim: usizeAuto Trait Implementations§
impl<'a> Freeze for ExpertWeightView<'a>
impl<'a> RefUnwindSafe for ExpertWeightView<'a>
impl<'a> Send for ExpertWeightView<'a>
impl<'a> Sync for ExpertWeightView<'a>
impl<'a> Unpin for ExpertWeightView<'a>
impl<'a> UnsafeUnpin for ExpertWeightView<'a>
impl<'a> UnwindSafe for ExpertWeightView<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more