Expand description
MCP tools for Local LLM GGUF Autoregressive Inference and Chat.
Migrated from legacy mcp_stub_impls.rs to dedicated library module.
Designed according to AGENTS.md §0-B (<500 lines).
Functions§
- list_
models list_modelstool — discovers GGUF models under local storage and reports any resident mounted model.- llm_
chat llm_chattool — multi-turn chat completion via the local GGUF inference engine.- llm_
infer llm_infertool — runs local GGUF model autoregressive inference.