Skip to main content

Module generation

Module generation 

Source
Expand description

Model residency identity and generation tracking.

Binds model execution plans and caches to a unique generation and content identity, ensuring that model replacement or LoRA adapter changes invalidate stale plans.

Structsยง

ModelResidencyIdentity
Content-bound model residency identity.
ResidencyGenerationTracker
Generation identity tracker for process-wide or engine-local model residency.