Skip to main content

Module raw_decode

Module raw_decode 

Source
Expand description

Fixed-step raw decoder benchmark.

This runner calls QTensorEngine directly. Product-level retrieval, graph drafting, governance, speculative acceptance, EOS, sampling and text rendering are deliberately absent.

Structs§

RawDecodeConfig
RawDecodeResult

Functions§

median_f64
Median of values (0.0 on empty).
percentile_nearest_rank
Nearest-rank quantile of values.
run_raw_decode_blocking
Blocking raw-decode bench run.