Skip to main content

Module prepared

Module prepared 

Source
Expand description

Backend-neutral prepared decode contract.

Re-exports§

pub use capability::BackendCapabilities;
pub use capability::KvEncoding;
pub use capability::SupportedArchitecture;
pub use generation::ModelResidencyIdentity;
pub use generation::ResidencyGenerationTracker;

Modules§

capability
Backend capability declarations.
generation
Model residency identity and generation tracking.

Structs§

DecodeStepInput
DecodeStepOutput

Enums§

DecodeStepError
PreparedBackend
PreparedPlanState

Traits§

PreparedDecodePlan
Tier-1 execution contract for an already prepared model/backend pair.