Module scheduler 

Bounded request scheduling for paged native inference.

Construction is cold and sizes every request table. Admission, prefix attachment, runnable collection, page COW, cancellation, and completion are zero-growth hot operations.

Structs

Admission

RaggedBatchItem

RaggedBatchOutput

RaggedBatchReceipt

RequestScheduler

Fixed-request-capacity scheduler. REQUESTS is the hard concurrent request bound.

RequestView

Enums

DecodeRoundError

RaggedBackendError

RequestState

SchedulerError

Traits

RaggedDecodeBackend

Prepared backend boundary for one continuous-batching decode round.