Skip to main content

insert_candidate

Function insert_candidate 

pub fn insert_candidate(
    out: &mut [TopKItem],
    count: usize,
    k: usize,
    token_id: u32,
    logit: f32,
) -> usize
Expand description

Bounded merge with the same score/id ordering as the reference merge.