Skip to main content

Module llm

Module llm 

Source
Expand description

MCP tools for Local LLM GGUF Autoregressive Inference and Chat.

Migrated from legacy mcp_stub_impls.rs to dedicated library module. Designed according to AGENTS.md §0-B (<500 lines).

Functions§

list_models
list_models tool — discovers GGUF models under local storage and reports any resident mounted model.
llm_chat
llm_chat tool — multi-turn chat completion via the local GGUF inference engine.
llm_infer
llm_infer tool — runs local GGUF model autoregressive inference.