Multiple Choice

A language model is tasked with completing the sentence: 'The old sea captain stared at the stormy sky and said, 'It's going to be a...'' The model's internal scores (logits) for the next token are highest for 'rough', followed by 'long', 'dark', and then 'whale'. The model generates two different completions using different settings:

  • Completion A: '...rough night.'
  • Completion B: '...whale of a tale.'

Based on the probability formula Pr(yi...)=exp(uyi/β)yjVexp(uyj/β)Pr(y_i|...) = \frac{\exp(u_{y_i} / \beta)}{\sum_{y_j \in V} \exp(u_{y_j} / \beta)}, which statement most accurately analyzes the relationship between the temperature parameter (β\beta) and the generated completions?

0

1

Updated 2025-10-07

Contributors are:

Who are from:

Tags

Ch.5 Inference - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science