pub fn perplexity(total_nll: f64, n_tokens: usize) -> f64
Perplexity from a summed NLL (nats) over n_tokens: exp(total_nll / n_tokens).
n_tokens
exp(total_nll / n_tokens)