Skip to main content

Module micro

qualia_core_db::inference::lab

Module micro 

Source
Expand description

Isolated Q4_K SoA GEMV microbench (CPU oracle + optional CUDA).

Structs§

MicrobenchResult

Functions§

run_q4k_soa_microbench
Run CPU Q4 SoA GEMV; if CUDA mode available, differential vs GPU.