Learn Before
Defining the Set of Complete Sequences
In a step-wise sequence generation process, Yi represents the set of all candidate sequences at step i. Explain what the notation Ψ(Yi) signifies and describe the defining characteristic of any sequence included in this specific subset.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Comprehension in Revised Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Formula for the Search Space as a Union of Complete Sequences
In a sequence generation process, a sequence is considered 'complete' if it ends with a special
⟨EOS⟩token. At a given stepi, the set of all candidate sequences isYi = {('The', 'cat', 'sat'), ('The', 'cat', 'slept', '⟨EOS⟩'), ('The', 'dog'), ('The', 'dog', 'barked', '⟨EOS⟩')}. IfΨ(Yi)represents the subset of sequences inYithat are complete, which of the following correctly identifiesΨ(Yi)?Defining the Set of Complete Sequences
In a step-wise sequence generation process, the set denoted by
Ψ(Yi)contains all candidate sequences from stepithat will be expanded to create new, longer sequences in the subsequent step.