Skip to main content

Module ollama

Module ollama 

Source
Expand description

Ollama HTTP backend — an external LLM reached over its REST API.

Uses blocking reqwest (this is a batch CLI tool, not an async service). base_url, model names and an optional bearer token are all configurable so the same backend also targets a hosted Ollama or a compatible proxy.

Structs§

OllamaBackend
OllamaConfig
Configuration for the Ollama backend.