Struct LexiconInterner 

pub struct LexiconInterner { /* private fields */ }

Collision-aware string interner — the lexicon collision backstop (task #22).

The plain build-time map (HashMap<u64, String> in external_sort) silently OVERWRITES on a handle collision (two distinct strings hashing to the same 60-bit token), losing data with no signal. This interner DETECTS the collision at intern time — O(1), off the resolution hot path — and KEEPS BOTH values, so a collision becomes loud + recoverable rather than silent corruption. Resolution stays single-value and fast for the (overwhelmingly common) collision-free handles; only a flagged handle pays a comparison over its small bucket (length-gated by str eq), from memory. This is a host-side structure (HashMap/String), separate from the 42 MB SlgArena — its allocations are one-time intern cost, not per-resolution.

Implementations

impl LexiconInterner

pub fn new() -> Self

pub fn intern_str(&mut self, value: &str) -> Intern

Intern (generate_60bit_token(value), value). Returns the collision outcome.

pub fn intern(&mut self, handle: u64, value: &str) -> Intern

Intern an explicit (handle, value) pair — the handle need not be generate_60bit_token(value) (e.g. did:q42 / Webizen handles). Detects a same-handle / different-value collision and preserves both values.

pub fn is_collision(&self, handle: u64) -> bool

Whether handle has more than one distinct interned value (a collision).

pub fn resolve(&self, handle: u64) -> Option<&str>

Resolve handle -> value with collision awareness. Collision-free (common): the single value, no comparison. Collided (rare): None — there is no single answer, so the caller disambiguates with the query value via Self::resolve_value rather than receiving a silently-wrong one.

pub fn resolve_value(&self, handle: u64, query: &str) -> Option<&str>

Disambiguating resolve — the backstop. Returns the stored value equal to query iff handle interns it. str equality length-gates before the byte compare, so the rare collision path stays cheap.

Trait Implementations

impl Default for LexiconInterner

fn default() -> LexiconInterner

Returns the “default value” for a type.