Skip to main content

Module graph_assist

Module graph_assist 

Source
Expand description

Explicit graph-assisted inference ABI.

Graph retrieval is a cold/request-bound workload reducer, never an implicit token-kernel side effect. Results, token spans, and prefix-page identities are caller-buffered and separately accounted so model throughput cannot be relabelled as retrieval throughput.

Structs§

GraphAssistPolicy
GraphQuery
GraphSelectionReceipt
PrefixIdentity
PrefixPageRegistry
Fixed-capacity prefix-page index. Lookup/insert/evict never allocate.
PrefixPageSet

Enums§

GraphQueryError
RegistryError

Functions§

derive_prefix_identity
Bind reusable KV pages to the exact model, tokenizer, graph scope/revision and selected facts.
query_graph_indexed_into
Select graph facts using a pre-built QuinIndex to scan only the narrowest non-wildcard posting list in ascending graph order ($O(k)$ candidate inspection instead of $O(N)$ full scan).
query_graph_into
Select graph facts directly from the flat Quin store into caller-owned storage.