Skip to main content

Module sticky_infer

Module sticky_infer 

Source

Structs§

StickyAdmissionDriver
Shared bounded intake manager for sticky infer execution (Work Package F4).
StickyEngine

Statics§

RESIDENCY_TRACKER
Global residency generation tracker for the sticky infer engine.

Functions§

current_residency_generation
Read the current residency generation number.
invalidate_sticky_residency
Advance the residency generation, invalidating cached sticky engine handles across all worker threads.
pool
Single-threaded rayon pool for sticky decode.
with_engine
Borrow-or-reload the sticky engine for path, then run f. Validates both pathname equality and residency generation freshness.
with_engine_disposition
Failed/uncertain turns discard the numerical owner on completion or unwind. No checkpoint digest is represented as a rollback image. The epoch advances before destruction, so queued/prepared handles cannot reuse this state.