Skip to main content

record_prefill

Function record_prefill 

Source
pub fn record_prefill(ns: u64, tokens: u64)
Expand description

Record prefill (prompt KV population) time + tokens prefilled.