Expand description
Fixed-step raw decoder benchmark.
This runner calls QTensorEngine directly. Product-level retrieval, graph drafting,
governance, speculative acceptance, EOS, sampling and text rendering are deliberately absent.
Structs§
Functions§
- median_
f64 - Median of
values(0.0 on empty). - percentile_
nearest_ rank - Nearest-rank
quantileofvalues. - run_
raw_ decode_ blocking - Blocking raw-decode bench run.