Struct GgufTensorInfo
pub struct GgufTensorInfo {
pub dims: [u64; 4],
pub n_dims: u32,
pub ggml_type: u32,
pub byte_offset: u64,
}Expand description
Shape + type + offset for one tensor parsed from the GGUF tensor-info section.
Fields§
§dims: [u64; 4]Tensor shape (up to 4 dimensions; extra dims truncated).
n_dims: u32§ggml_type: u32GGML element type: 0=F32, 1=F16, 8=Q8_0, 12=Q4_K, …
byte_offset: u64Byte offset of this tensor’s data within the tensor data block.
Implementations§
§impl TensorInfo
impl TensorInfo
pub fn row_range(self, first_row: usize, row_count: usize) -> Option<TensorInfo>
pub fn row_range(self, first_row: usize, row_count: usize) -> Option<TensorInfo>
Return a zero-copy view over a contiguous row range of a matrix tensor.
GGUF stores fused QKV as consecutive projection rows. This view adjusts the relative byte offset and row count without materialising or dequantising the full fused tensor. It deliberately rejects tensors with batch dimensions: expert tensors are selected by their dedicated 3-D evaluator rather than pretending they are ordinary projections.
§impl TensorInfo
impl TensorInfo
pub fn encoding(&self) -> WeightEncoding
Trait Implementations§
§impl Clone for TensorInfo
impl Clone for TensorInfo
§fn clone(&self) -> TensorInfo
fn clone(&self) -> TensorInfo
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for TensorInfo
§impl Debug for TensorInfo
impl Debug for TensorInfo
impl Eq for TensorInfo
§impl PartialEq for TensorInfo
impl PartialEq for TensorInfo
impl StructuralPartialEq for TensorInfo
Auto Trait Implementations§
impl Freeze for TensorInfo
impl RefUnwindSafe for TensorInfo
impl Send for TensorInfo
impl Sync for TensorInfo
impl Unpin for TensorInfo
impl UnsafeUnpin for TensorInfo
impl UnwindSafe for TensorInfo
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more