Expand description
Catalog LLM download → GGUF shard map → WAL → lifecycle (in-process).
Structs§
- Active
Model Record - Install
Manifest - Model
Install Result - Model
Status - Vault
Duplicate Group - Exact duplicate GGUF files, grouped by content rather than filename.
- Vault
Gguf Entry - Discovered weight container in a vault directory (CLI / lifecycle tooling).
Enums§
Constants§
- MEMORY_
FLOOR_ MB - UI RAM ceiling for LLM arena pressure (matches 0.0.12 Flutter plan).
Functions§
- activate_
model - activate_
model_ for_ id - activate_
vault_ gguf - Map and activate a vault weight file (
.p64preferred, or.gguf) without catalog install. - audit_
vault_ duplicates - Hash only same-sized GGUF candidates and report byte-identical duplicates.
- finalize_
llm_ install - finalize_
local_ gguf - Register and activate a user-selected
.gguffile at an arbitrary path. - get_
kv_ cache_ used_ mb - get_
last_ decode_ tok_ s - Last measured tok/s from a completed turn, or
Noneif never measured this process. - get_
last_ decode_ tok_ s_ at_ unix - get_
llm_ memory_ bytes - get_
model_ lifecycle_ state - get_
model_ status - get_
thermal_ state_ label - install_
catalog_ llm - lifecycle_
label - load_
install_ manifest - models_
dir - record_
kv_ cache_ used_ mb - record_
last_ decode_ tok_ s - Record measured decode/chat throughput from a completed generation turn.
- record_
llm_ memory_ bytes - record_
llm_ memory_ sample - resolve_
vault_ model - Resolve a model reference (filename, stem, or path) inside
vault_dir. - scan_
vault_ gguf - Recursively scan
vault_dirfor.p64and.ggufweight containers. - task_
orchestrator - Shared orchestrator for chat inference and model lifecycle transitions.
- unload_
active_ model - wait_
for_ eviction_ scrub - Block until eviction scrub completes or
timeoutelapses.