Skip to main content

MAX_PREFILL_BATCH_FLOATS

qualia_core_db::gguf_bridge

Constant MAX_PREFILL_BATCH_FLOATS 

Source 
pub const MAX_PREFILL_BATCH_FLOATS: usize = _; // 655_360usize
Expand description

Max stacked embedding floats in a prefill chunk (MAX_STACK_GEMM_IN × 64).