Skip to main content

mount_resident_gguf

Function mount_resident_gguf 

Source
pub fn mount_resident_gguf(
    model_id: u64,
    path: &str,
    mlock: bool,
) -> Result<GgufLoadReport, String>
Expand description

Memory-map path and retain until clear_resident_model.

Accepts GGUF or P64 (sniffed by magic). Prefer calling mount_resident_model; this name remains for callers that still say “gguf”.