Expand description
Process-wide resident GGUF mmap — released explicitly on model eviction.
Structs§
Functions§
- clear_
resident_ model - Drop resident mmap (called from orchestrator eviction scrub).
- mount_
resident_ gguf - Memory-map
pathand retain untilclear_resident_model. - mount_
resident_ model - Memory-map a local model and select P64 or GGUF by canonical magic.
- mount_
resident_ q42 - Memory-map a P64 weight container and retain it as the resident model.
- resident_
gguf_ path - resident_
mmap_ for_ path - resident_
model_ id