Expand description
Backend-neutral prepared decode contract.
Re-exports§
pub use capability::BackendCapabilities;pub use capability::KvEncoding;pub use capability::SupportedArchitecture;pub use generation::ModelResidencyIdentity;pub use generation::ResidencyGenerationTracker;
Modules§
- capability
- Backend capability declarations.
- generation
- Model residency identity and generation tracking.
Structs§
Enums§
Traits§
- Prepared
Decode Plan - Tier-1 execution contract for an already prepared model/backend pair.