Learn Before
Sequence Construction in Speculative Decoding
Using the provided information from a single step of a speculative decoding process, construct the complete, updated sequence of confirmed tokens.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
In a speculative decoding process, the sequence of confirmed tokens before a specific step is
['The', 'quick', 'brown', 'fox']. After this single step completes, the new confirmed sequence is['The', 'quick', 'brown', 'fox', 'jumps', 'over', 'the']. Given this outcome, which of the following represents the set of accepted draft tokens, denoted as ?Sequence Construction in Speculative Decoding
A text generation process begins with the confirmed sequence
['The', 'quick', 'brown']. After a single generation step, the new confirmed sequence is['The', 'quick', 'brown', 'fox', 'jumps', 'over']. Based on this, evaluate the following statement: 'The set of accepted draft tokens, represented as , for this step is['fox', 'jumps', 'over'].'