Notation for the Set of Complete Sequences
The notation Ψ(Yi) represents the subset of sequences within the candidate set Yi at step i that are considered complete.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Notation for the Set of Complete Sequences
In a step-by-step sequence generation process, a set of candidate sequences is maintained and expanded at each step. Suppose at a given step, the current set of candidate sequences is:
["The cat sat", "The dog ran ⟨EOS⟩", "The cat slept on"]Assuming
⟨EOS⟩is a special token indicating the end of a sequence, which of these sequences will be used as a basis for generating longer sequences in the next step?Applying a Stopping Condition in Sequence Expansion
Efficiency of Sequence Expansion
Learn After
Formula for the Search Space as a Union of Complete Sequences
In a sequence generation process, a sequence is considered 'complete' if it ends with a special
⟨EOS⟩token. At a given stepi, the set of all candidate sequences isYi = {('The', 'cat', 'sat'), ('The', 'cat', 'slept', '⟨EOS⟩'), ('The', 'dog'), ('The', 'dog', 'barked', '⟨EOS⟩')}. IfΨ(Yi)represents the subset of sequences inYithat are complete, which of the following correctly identifiesΨ(Yi)?Defining the Set of Complete Sequences
In a step-wise sequence generation process, the set denoted by
Ψ(Yi)contains all candidate sequences from stepithat will be expanded to create new, longer sequences in the subsequent step.