Expand description
Shared-device and host-policy adapter for the canonical Metal lane.
Structs§
- Metal
Pass Layer Dims - Per-layer matmul dimensions (pre-computed by caller).
- Metal
Pass Layer Weights - Per-layer weight references for the Metal mega-pass.
Enums§
- Metal
Capability State - Operational capability state for the Metal mega-pass lane.
Constants§
- METAL_
PREFETCH_ STAGING_ CAPACITY - Maximum capacity (64 MiB) for the reusable Metal prefetch staging buffer.
- Q4_
K_ BLOCK_ BYTES - Bytes per Q4_K block: 2-byte
f16scale + 2-bytef16min + 16 nibble bytes. - Q8_
0_ BLOCK_ BYTES - Bytes per Q8_0 block: 2-byte
f16scale + 32i8quants. - QUANT_
BLOCK_ ELEMS - Elements per quantized block (Q8_0 and Q4_K).