Skip to main content

Module capability

Module capability 

Source
Expand description

Backend capability declarations.

A capability record declares the exact model architectures, quantization formats, KV-cache encodings, maximum batch sizes, and graph acceleration modes supported by a given prepared backend.

Structs§

BackendCapabilities
Explicit capability declaration for a prepared backend.

Enums§

KvEncoding
Supported KV cache encoding formats.
SupportedArchitecture
Supported neural model architecture families.