Skip to main content

GGML_F32

Constant GGML_F32 

Source
pub const GGML_F32: u32 = 0;
Expand description

GGML element type codes used here (mirrors gguf_sharder): 0=F32, 1=F16, 8=Q8_0, 30=BF16; low-precision quants are Q4_0=2, Q4_1=3, Q4_K=12, ….