Skip to main content

Module model_lifecycle

Module model_lifecycle 

Source
Expand description

Catalog LLM download → GGUF shard map → WAL → lifecycle (in-process).

Structs§

ActiveModelRecord
InstallManifest
ModelInstallResult
ModelStatus
VaultDuplicateGroup
Exact duplicate GGUF files, grouped by content rather than filename.
VaultGgufEntry
Discovered weight container in a vault directory (CLI / lifecycle tooling).

Enums§

ModelError

Constants§

MEMORY_FLOOR_MB
UI RAM ceiling for LLM arena pressure (matches 0.0.12 Flutter plan).

Functions§

activate_model
Activates a model.
activate_model_for_id
Activates a model by ID.
activate_vault_gguf
Map and activate a vault weight file (.p64 preferred, or .gguf) without catalog install.
audit_vault_duplicates
Hash only same-sized GGUF candidates and report byte-identical duplicates.
finalize_llm_install
Finalizes an LLM install.
finalize_local_gguf
Register and activate a user-selected .gguf file at an arbitrary path.
get_kv_cache_used_mb
Gets kv-cache-used-mb.
get_last_decode_tok_s
Last measured tok/s from a completed turn, or None if never measured this process.
get_last_decode_tok_s_at_unix
Gets last-decode-tok-s-at-unix.
get_llm_memory_bytes
Gets llm-memory-bytes.
get_model_lifecycle_state
Gets model-lifecycle-state.
get_model_status
Gets model-status.
get_thermal_state_label
Gets thermal-state-label.
install_catalog_llm
Installs a catalog LLM.
lifecycle_label
lifecycle label.
load_install_manifest
Loads install-manifest.
models_dir
Models directory.
record_kv_cache_used_mb
Records KV-cache usage.
record_last_decode_tok_s
Record measured decode/chat throughput from a completed generation turn.
record_llm_memory_bytes
Records LLM memory bytes.
record_llm_memory_sample
Records an LLM memory sample.
resolve_vault_model
Resolve a model reference (filename, stem, or path) inside vault_dir.
scan_vault_gguf
Recursively scan vault_dir for .p64 and .gguf weight containers.
task_orchestrator
Shared orchestrator for chat inference and model lifecycle transitions.
unload_active_model
Unloads the active model.
wait_for_eviction_scrub
Block until eviction scrub completes or timeout elapses.