Skip to main content

run_gather_qwen4exp_ple

Function run_gather_qwen4exp_ple 

Source
pub fn run_gather_qwen4exp_ple(
    package: &Path,
    token_ids: &[u32],
) -> Result<(), String>
Expand description

Compute the checkpoint’s PLE n-gram row IDs from decode-order token IDs, then gather exactly those rows from the C:-resident table. This is an execution seam, not a text-generation benchmark: it proves that runtime token history selects and consumes trained PLE rows without mapping the table or using a synthetic hash.