Skip to main content

INFERENCE_TIMEOUT_MS

qualia_core_db::inference::inference_agent

Constant INFERENCE_TIMEOUT_MS 

Source 
pub const INFERENCE_TIMEOUT_MS: u64 = 30_000;
Expand description

Default maximum milliseconds for a local inference call (interactive). Batch/overnight profile raises this via llm_bench::inference_timeout_ms().