Skip to main content

llm_infer

Function llm_infer 

Source
pub fn llm_infer(args: &[u8]) -> Result<String, McpSystemError>
Expand description

llm_infer tool — runs local GGUF model autoregressive inference.