Skip to main content

Module graph_assist

Module graph_assist 

Source
Expand description

Explicit graph-assisted inference ABI.

Graph retrieval is a cold/request-bound workload reducer, never an implicit token-kernel side effect. Results, token spans, and prefix-page identities are caller-buffered and separately accounted so model throughput cannot be relabelled as retrieval throughput.

Structs§

GraphAssistPolicy
GraphQuery
GraphSelectionReceipt
PrefixIdentity
PrefixPageRegistry
Fixed-capacity prefix-page index. Lookup/insert/evict never allocate.
PrefixPageSet

Enums§

GraphQueryError
RegistryError

Functions§

derive_prefix_identity
Bind reusable KV pages to the exact model, tokenizer, graph scope/revision and selected facts.
query_graph_into
Select graph facts directly from the flat Quin store into caller-owned storage.