Struct QwenCheckpointRegistry
pub struct QwenCheckpointRegistry { /* private fields */ }Expand description
Registry of checkpoints for a multi-turn conversation or generation run.
Implementations§
§impl QwenCheckpointRegistry
impl QwenCheckpointRegistry
pub fn new(max_checkpoints: usize) -> QwenCheckpointRegistry
pub fn new(max_checkpoints: usize) -> QwenCheckpointRegistry
Creates a default QwenCheckpointRegistry.
pub fn push(&mut self, checkpoint: QwenDualCheckpoint)
pub fn push(&mut self, checkpoint: QwenDualCheckpoint)
Push a verified checkpoint.
pub fn find_compatible(
&self,
target_tokens: u32,
kv_hash: u64,
recurrent_digest: &[u8; 32],
) -> Option<&QwenDualCheckpoint>
pub fn find_compatible( &self, target_tokens: u32, kv_hash: u64, recurrent_digest: &[u8; 32], ) -> Option<&QwenDualCheckpoint>
Find the deepest checkpoint that satisfies prefix compatibility.
pub fn clear(&mut self)
pub fn clear(&mut self)
Clear all registered checkpoints (e.g. on model swap or context reset).
Trait Implementations§
§impl Debug for QwenCheckpointRegistry
impl Debug for QwenCheckpointRegistry
§impl Default for QwenCheckpointRegistry
impl Default for QwenCheckpointRegistry
§fn default() -> QwenCheckpointRegistry
fn default() -> QwenCheckpointRegistry
Returns the “default value” for a type. Read more
Auto Trait Implementations§
impl Freeze for QwenCheckpointRegistry
impl RefUnwindSafe for QwenCheckpointRegistry
impl Send for QwenCheckpointRegistry
impl Sync for QwenCheckpointRegistry
impl Unpin for QwenCheckpointRegistry
impl UnsafeUnpin for QwenCheckpointRegistry
impl UnwindSafe for QwenCheckpointRegistry
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> NoneValue for Twhere
T: Default,
impl<T> NoneValue for Twhere
T: Default,
type NoneType = T
§fn null_value() -> T
fn null_value() -> T
The none-equivalent value.