Expand description
Process-wide resident GGUF mmap — released explicitly on model eviction.
Structs§
Functions§
- clear_
resident_ model - Drop resident mmap (called from orchestrator eviction scrub).
- current_
resident_ mmap - Current resident mmap if one is actively mounted in the resident slot.
- mount_
resident_ gguf - Memory-map
pathand retain untilclear_resident_model. - mount_
resident_ model - Memory-map a local model and select P64 or GGUF by canonical magic.
- mount_
resident_ q42 - Memory-map a P64 weight container and retain it as the resident model.
- resident_
gguf_ path - Resident model path.
- resident_
mmap_ for_ path - Resident mmap for
pathwhen it matches the slot. - resident_
model_ id - Resident model id.