Skip to main content

Module memory_guard

Module memory_guard 

Source
Expand description

Fail-closed host-memory pressure policy for native inference.

Platform probes provide committed and available-memory samples; this module makes the decision deterministic. It deliberately never tries to force a giant working set resident: that is not a Windows residency guarantee and can make system-wide pressure worse.

Structs§

HostMemorySample
A point-in-time sample supplied by a platform monitor.
MemoryPressureGuard
Pure, zero-allocation pressure evaluator.
MemoryPressurePolicy
Cold-configured host-memory thresholds for one native runtime.

Enums§

MemoryPolicyError
MemoryPressureAction
Required reaction before an allocation failure or OS-level instability.