#[repr(C)]pub struct InferenceCacheKey {
pub governed_scope: Option<[u8; 32]>,
pub model_instance: u64,
pub tokenizer_revision: u64,
pub adapter_hash: u64,
pub tenant_scope: u64,
pub profile_spec_hash: u64,
pub prompt_tokens_digest: [u64; 4],
pub prompt_token_count: u32,
pub graph_context_digest: u64,
pub kv_floats: usize,
pub n_layers: usize,
}Expand description
Strongly-typed cache key requiring exact compatibility across model, tokens, graph, and tensor geometry.
Fields§
§governed_scope: Option<[u8; 32]>Full SHA-256 scope from the real governed admission. Developer caches never collide with an admitted model/request/actor/policy/device scope.
model_instance: u64§tokenizer_revision: u64§adapter_hash: u64§tenant_scope: u64§profile_spec_hash: u64§prompt_tokens_digest: [u64; 4]§prompt_token_count: u32§graph_context_digest: u64§kv_floats: usize§n_layers: usizeImplementations§
Source§impl InferenceCacheKey
impl InferenceCacheKey
Sourcepub fn new(
model_instance: u64,
tokenizer_revision: u64,
prompt_tokens: &[u32],
graph_context_digest: u64,
kv_floats: usize,
n_layers: usize,
) -> Self
pub fn new( model_instance: u64, tokenizer_revision: u64, prompt_tokens: &[u32], graph_context_digest: u64, kv_floats: usize, n_layers: usize, ) -> Self
Creates a default InferenceCacheKey.
Sourcepub fn with_provenance(
model_instance: u64,
tokenizer_revision: u64,
adapter_hash: u64,
tenant_scope: u64,
profile_spec_hash: u64,
prompt_tokens: &[u32],
graph_context_digest: u64,
kv_floats: usize,
n_layers: usize,
) -> Self
pub fn with_provenance( model_instance: u64, tokenizer_revision: u64, adapter_hash: u64, tenant_scope: u64, profile_spec_hash: u64, prompt_tokens: &[u32], graph_context_digest: u64, kv_floats: usize, n_layers: usize, ) -> Self
Builder: sets provenance.
pub fn with_governed_scope(self, scope: Option<[u8; 32]>) -> Self
Trait Implementations§
Source§impl Clone for InferenceCacheKey
impl Clone for InferenceCacheKey
impl Copy for InferenceCacheKey
Source§impl Debug for InferenceCacheKey
impl Debug for InferenceCacheKey
impl Eq for InferenceCacheKey
Source§impl Hash for InferenceCacheKey
impl Hash for InferenceCacheKey
Source§impl PartialEq for InferenceCacheKey
impl PartialEq for InferenceCacheKey
impl StructuralPartialEq for InferenceCacheKey
Auto Trait Implementations§
impl Freeze for InferenceCacheKey
impl RefUnwindSafe for InferenceCacheKey
impl Send for InferenceCacheKey
impl Sync for InferenceCacheKey
impl Unpin for InferenceCacheKey
impl UnsafeUnpin for InferenceCacheKey
impl UnwindSafe for InferenceCacheKey
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more