Struct SamplerConfig 

pub struct SamplerConfig {
    pub temperature: f32,
    pub top_k: u32,
    pub top_p: f32,
    pub repeat_penalty: f32,
    pub freq_penalty: f32,
    pub presence_penalty: f32,
    pub penalty_window: u32,
    pub seed: u64,
}

Sampling parameters. temperature <= 0.0 ⇒ greedy argmax (all other fields ignored).

The canonical wire form is a CBOR map (the project’s CBOR-first payload substrate) — see SamplerConfig::to_cbor / SamplerConfig::from_cbor. Transports that are JSON-enveloped (e.g. the MCP boundary) carry it as a hex-encoded CBOR blob, decoded via the existing JSON string helper — no ad-hoc per-field JSON float parsing.

Fields

temperature: f32

Softmax temperature. <= 0.0 selects greedy argmax (the pre-W2 default behaviour).

top_k: u32

Keep only the top_k highest-logit tokens (0 ⇒ no top-k limit).

top_p: f32

Nucleus threshold in (0.0, 1.0]; keep the smallest set whose cumulative prob ≥ top_p (>= 1.0 ⇒ no top-p limit).

repeat_penalty: f32

Multiplicative penalty on logits of tokens present in the penalty window (1.0 ⇒ none).

freq_penalty: f32

Additive penalty per prior occurrence in the window (subtracted from the logit).

presence_penalty: f32

Additive penalty for any presence in the window (subtracted once).

penalty_window: u32

Number of most-recent context tokens the penalties consider (0 ⇒ whole context).

seed: u64

PRNG seed — fixed seed ⇒ reproducible draws.

Implementations

impl SamplerConfig

pub fn is_greedy(&self) -> bool

True when this config selects the greedy argmax short-circuit.

pub fn to_cbor(&self) -> Vec<u8>

Encode as a CBOR map (the canonical payload form). Infallible for this fixed scalar schema.

pub fn from_cbor(bytes: &[u8]) -> Option<Self>

Decode from a CBOR map payload. Returns None on malformed CBOR or a schema mismatch — the caller then keeps greedy decode rather than sampling on a bad config.

pub fn chat_default() -> Self

A sensible default for interactive chat / instruct generation: enough randomness to avoid the greedy repetition-collapse, plus a light repeat penalty, while staying reproducible (fixed seed). Benchmarks and determinism tests must NOT install this — the unconfigured global stays greedy, preserving the bit-exact a1a/a6a guarantees.

Trait Implementations

impl Clone for SamplerConfig

fn clone(&self) -> SamplerConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SamplerConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SamplerConfig

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for SamplerConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for SamplerConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Copy for SamplerConfig