Skip to main content

Module execution

Module execution 

Source

Structs§

ArtifactCleanupCounters
ExecutionCounters
ExecutionReceipt
RequestLatencyTelemetry

Enums§

BackendKind

Constants§

COUNTER_ADMITTED_REQUESTS
COUNTER_CACHED_PREFILL_TOKENS
COUNTER_CANCELLATIONS
COUNTER_COMMITTED_PREFILL_TOKENS
COUNTER_COMPILE_CALLS
COUNTER_COMPUTE_DISPATCHES
COUNTER_COW_COPIES
COUNTER_DECODE_STEPS
COUNTER_DEVICE_FENCES
COUNTER_DEVICE_TO_HOST_BYTES
COUNTER_EVICTIONS
COUNTER_FALLBACKS
COUNTER_GRAPH_BUCKET_TOKENS
COUNTER_GRAPH_LAUNCHES
COUNTER_GRAPH_PADDING_TOKENS
COUNTER_HOST_TO_DEVICE_BYTES
COUNTER_HOT_ALLOCATIONS
COUNTER_IMMUTABLE_UPLOAD_BYTES
COUNTER_INTER_TOKEN_LATENCY_US
COUNTER_POOL_HIGH_WATER_BYTES
COUNTER_QUEUED_REQUESTS
COUNTER_QUEUE_DELAY_US
COUNTER_REBUILD_OUTCOMES
COUNTER_SUBMITTED_PREFILL_TOKENS
COUNTER_TIME_TO_FIRST_TOKEN_US
COUNTER_UNIQUE_FREED_PAGES
RECEIPT_SCHEMA_VERSION