Notation for the Set of Complete Sequences
The notation Ψ(Yi) represents the subset of sequences within the candidate set Yi at step i that are considered complete.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
In a step-by-step sequence generation process, a set of candidate sequences is maintained and expanded at each step. Suppose at a given step, the current set of candidate sequences is:
["The cat sat", "The dog ran ⟨EOS⟩", "The cat slept on"]Assuming
⟨EOS⟩is a special token indicating the end of a sequence, which of these sequences will be used as a basis for generating longer sequences in the next step?Applying a Stopping Condition in Sequence Expansion
Efficiency of Sequence Expansion
Learn After
Formula for the Search Space as a Union of Complete Sequences
In a sequence generation process, a sequence is considered 'complete' if it ends with a special
⟨EOS⟩token. At a given stepi, the set of all candidate sequences isYi = {('The', 'cat', 'sat'), ('The', 'cat', 'slept', '⟨EOS⟩'), ('The', 'dog'), ('The', 'dog', 'barked', '⟨EOS⟩')}. IfΨ(Yi)represents the subset of sequences inYithat are complete, which of the following correctly identifiesΨ(Yi)?Defining the Set of Complete Sequences
In a step-wise sequence generation process, the set denoted by
Ψ(Yi)contains all candidate sequences from stepithat will be expanded to create new, longer sequences in the subsequent step.
Learn After
Formula for the Search Space as a Union of Complete Sequences
In a sequence generation process, a sequence is considered 'complete' if it ends with a special
⟨EOS⟩token. At a given stepi, the set of all candidate sequences isYi = {('The', 'cat', 'sat'), ('The', 'cat', 'slept', '⟨EOS⟩'), ('The', 'dog'), ('The', 'dog', 'barked', '⟨EOS⟩')}. IfΨ(Yi)represents the subset of sequences inYithat are complete, which of the following correctly identifiesΨ(Yi)?Defining the Set of Complete Sequences
In a step-wise sequence generation process, the set denoted by
Ψ(Yi)contains all candidate sequences from stepithat will be expanded to create new, longer sequences in the subsequent step.
Related
In a step-by-step sequence generation process, a set of candidate sequences is maintained and expanded at each step. Suppose at a given step, the current set of candidate sequences is:
["The cat sat", "The dog ran ⟨EOS⟩", "The cat slept on"]Assuming
⟨EOS⟩is a special token indicating the end of a sequence, which of these sequences will be used as a basis for generating longer sequences in the next step?Applying a Stopping Condition in Sequence Expansion
Efficiency of Sequence Expansion