Skip to main content

Module trunk_nvme

Module trunk_nvme 

Source
Expand description

Compatibility exports for the canonical Etalon Qwen engine.

Structs§

StreamedArgmax
Exact winner from a streamed vocabulary projection. The token id is a flattened row number in the output tensor.
TrunkIoStats
Cumulative physical I/O accounting for one reader. reads counts file read calls (chunked), rows counts model rows consumed, bytes the raw encoded weight bytes pulled from storage.
TrunkNvmeReader
One encoded-weight source cursor. It owns no model payload; caller buffers bound each individual read/dequantization operation. A fixed 4 MiB read chunk amortizes syscalls across consecutive rows without holding model weights; it carries raw bytes only.

Enums§

TrunkNvmeError