Skip to main content

enable

Function enable 

Source
pub fn enable(n_layer: usize, max_per_layer: usize)
Expand description

Begin a KV capture for a model with up to n_layer layers, keeping at most max_per_layer K and max_per_layer V vectors per layer. head_dim self-sizes on the first recorded vector.