Skip to main content

Module library

Module library 

Source
Expand description

The semantic library: an index over a directory of .hmc containers.

Reading just the manifests is cheap (they are stored uncompressed at the top of each zip), so a catalog of thousands of documents builds fast without unpacking heavy assets. Embeddings are loaded on demand for dedup and search.

This is where the “optimisation manifold” lives: documents become points in embedding space, so the library can collapse near-duplicates, route a query to the relevant region, and rank chunks by relevance/novelty — instead of scanning every byte of a 60 GB corpus.

Structs§

Entry
One catalogued container (manifest + path; assets read on demand).
Hit
A chunk-level search hit.
Library
In-memory catalog of a library directory.