Struct RequestReservation
pub struct RequestReservation {
pub input_tokens: u32,
pub reserved_output_tokens: u32,
pub required_blocks: u32,
pub cow_transient_blocks: u32,
pub reserved_bytes: u64,
}Expand description
An admitted request’s checked memory reservation.
Fields§
§input_tokens: u32Number of prompt tokens admitted.
reserved_output_tokens: u32Number of output tokens strictly reserved for autoregressive generation.
required_blocks: u32Physical blocks required to house (input + output) tokens.
cow_transient_blocks: u32Transient blocks reserved for copy-on-write page forks.
reserved_bytes: u64Total bytes reserved on the device for this request.
Trait Implementations§
§impl Clone for RequestReservation
impl Clone for RequestReservation
§fn clone(&self) -> RequestReservation
fn clone(&self) -> RequestReservation
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for RequestReservation
§impl Debug for RequestReservation
impl Debug for RequestReservation
impl Eq for RequestReservation
§impl PartialEq for RequestReservation
impl PartialEq for RequestReservation
impl StructuralPartialEq for RequestReservation
Auto Trait Implementations§
impl Freeze for RequestReservation
impl RefUnwindSafe for RequestReservation
impl Send for RequestReservation
impl Sync for RequestReservation
impl Unpin for RequestReservation
impl UnsafeUnpin for RequestReservation
impl UnwindSafe for RequestReservation
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more