Structs§
Enums§
Constants§
- COUNTER_
ADMITTED_ REQUESTS - COUNTER_
CACHED_ PREFILL_ TOKENS - COUNTER_
CANCELLATIONS - COUNTER_
COMMITTED_ PREFILL_ TOKENS - COUNTER_
COMPILE_ CALLS - COUNTER_
COMPUTE_ DISPATCHES - COUNTER_
COW_ COPIES - COUNTER_
DECODE_ STEPS - COUNTER_
DEVICE_ FENCES - COUNTER_
DEVICE_ TO_ HOST_ BYTES - COUNTER_
EVICTIONS - COUNTER_
FALLBACKS - COUNTER_
GRAPH_ BUCKET_ TOKENS - COUNTER_
GRAPH_ LAUNCHES - COUNTER_
GRAPH_ PADDING_ TOKENS - COUNTER_
HOST_ TO_ DEVICE_ BYTES - COUNTER_
HOT_ ALLOCATIONS - COUNTER_
IMMUTABLE_ UPLOAD_ BYTES - COUNTER_
INTER_ TOKEN_ LATENCY_ US - COUNTER_
POOL_ HIGH_ WATER_ BYTES - COUNTER_
QUEUED_ REQUESTS - COUNTER_
QUEUE_ DELAY_ US - COUNTER_
REBUILD_ OUTCOMES - COUNTER_
SUBMITTED_ PREFILL_ TOKENS - COUNTER_
TIME_ TO_ FIRST_ TOKEN_ US - COUNTER_
UNIQUE_ FREED_ PAGES - RECEIPT_
SCHEMA_ VERSION