Skip to main content

atoms_flat

Function atoms_flat 

Source
pub fn atoms_flat() -> Option<(Vec<f32>, usize, usize)>
Expand description

Flatten the installed atoms into the arena layout [layer][K atoms n_atoms×head_dim][V atoms …], with (flat, n_atoms, head_dim); layers/streams with no dictionary are zero (never selected). The engine uploads this into the tail of each layer’s KV-arena slice for the GPU shader to reconstruct.