Struct RequestScheduler 

pub struct RequestScheduler<const REQUESTS: usize> { /* private fields */ }

Fixed-request-capacity scheduler. REQUESTS is the hard concurrent request bound.

Implementations

impl<const REQUESTS: usize> RequestScheduler<REQUESTS>

pub fn new(logical_pages: u32) -> Self

Cold construction; allocates each fixed-capacity logical page table exactly once.

pub fn active_count(&self) -> usize

pub fn admit_with_prefix<const ENTRIES: usize, const PAGES: usize>( &mut self, request_id: u64, identity: Option<PrefixIdentity>, prefixes: &PrefixKvStore<ENTRIES, PAGES>, pool: &mut BlockPool, ) -> Result<Admission, SchedulerError>

Admit a request and atomically attach graph-derived prefix pages when available.

pub fn ensure_writable( &mut self, request_id: u64, logical_page: u32, pool: &mut BlockPool, ) -> Result<CopyOnWrite, SchedulerError>

Make a logical page writable. A Copy result instructs the backend to copy the physical KV page before writing the next token.

pub fn mark_prefill_complete( &mut self, request_id: u64, ) -> Result<(), SchedulerError>

pub fn seed_decode_token( &mut self, request_id: u64, token_id: u32, ) -> Result<(), SchedulerError>

Publish the token consumed by the request’s next decode step.

pub fn record_token(&mut self, request_id: u64) -> Result<u32, SchedulerError>

pub fn runnable_into( &self, out: &mut [RequestView], ) -> Result<usize, SchedulerError>

Write all runnable requests into caller storage in stable slot order.

pub fn execute_decode_round<B: RaggedDecodeBackend>( &mut self, backend: &mut B, item_scratch: &mut [RaggedBatchItem], block_table_scratch: &mut [u32], output_scratch: &mut [RaggedBatchOutput], ) -> Result<RaggedBatchReceipt, DecodeRoundError>

Execute one ragged decode round with exactly one backend call.

Active decode requests are lowered in stable scheduler-slot order. Their logical page tables are concatenated into block_table_scratch; each item carries its table offset. Outputs are identity-checked as a complete batch before scheduler state is mutated.

pub fn finish( &mut self, request_id: u64, pool: &mut BlockPool, ) -> Result<(), SchedulerError>

Cancellation and normal completion have identical deterministic resource release.