Skip to main content

Module resident_model

Module resident_model 

Source
Expand description

Process-wide resident GGUF mmap — released explicitly on model eviction.

Structs§

ResidentModelSlot

Functions§

clear_resident_model
Drop resident mmap (called from orchestrator eviction scrub).
mount_resident_gguf
Memory-map path and retain until clear_resident_model.
mount_resident_model
Memory-map a local model and select P64 or GGUF by canonical magic.
mount_resident_q42
Memory-map a P64 weight container and retain it as the resident model.
resident_gguf_path
resident_mmap_for_path
resident_model_id