Skip to main content

Module poet_llm_api

Module poet_llm_api 

Source
Expand description

Local-model chat boundary for the standalone POET browser.

Structs§

PoetLlmRequest

Constants§

LLM_REQUEST_LIMIT_BYTES

Functions§

activate_model_handler
HTTP activate-model handler.
evict_model_handler
HTTP evict-model handler.
generate_handler
Generates handler.
models_handler
Return only model files explicitly mounted, configured through QUALIA_MODEL_PATHS, or present in QualiaDB’s documented model locations. Directories are scanned one level deep and the result is bounded.