Expand description
Safe maintenance, idle-drain state machine, and generation invalidation (Work Package F7).
Provides deterministic coordination for quiescing active continuous-batching executions before model eviction, memory defragmentation, CUDA graph rebuilds, or block-pool re-sizing.
Structs§
- Drain
Controller - Controller coordinating safe quiescence and maintenance transitions.
Enums§
- Drain
Error - Errors returned by drain controller state transitions.
- Drain
Reason - The trigger or reason for requesting a scheduler drain.
- Drain
State - Lifecycle states of the scheduler drain controller.