Expand description
Compatibility exports for the canonical Etalon Qwen engine.
Structs§
- Streamed
Argmax - Exact winner from a streamed vocabulary projection. The token id is a flattened row number in the output tensor.
- Trunk
IoStats - Cumulative physical I/O accounting for one reader.
readscounts file read calls (chunked),rowscounts model rows consumed,bytesthe raw encoded weight bytes pulled from storage. - Trunk
Nvme Reader - One encoded-weight source cursor. It owns no model payload; caller buffers bound each individual read/dequantization operation. A fixed 4 MiB read chunk amortizes syscalls across consecutive rows without holding model weights; it carries raw bytes only.