Skip to main content

Module native_runtime

Module native_runtime 

Source
Expand description

Activation for a Qwen4Exp package with an NVMe-resident PLE payload.

Activation reads a bounded GGUF metadata header from the external trunk on E:, opens the C: PLE cursor for row gathers, and opens the trunk either as an ordinary file cursor (Streamed, default) or as a read-only mmap (Mapped) so the OS page cache keeps trunk weights in RAM. It never creates a swap-backed decoded copy of the model either way.

Structs§

Qwen4ExpNativeRuntime
A live package binding. In Streamed residency the file cursors retain no model data in memory; in Mapped residency the trunk is a read-only page-cache view. Decoder state and all compute scratch remain caller owned either way.

Enums§

Qwen4ExpActivationError
Qwen4ExpTrunkResidency
How the trunk weights are reached during decode.