Function insert_candidate
pub fn insert_candidate(
out: &mut [TopKItem],
count: usize,
k: usize,
token_id: u32,
logit: f32,
) -> usizeExpand description
Bounded merge with the same score/id ordering as the reference merge.