Error Analysis in Sequence Expansion
A developer is implementing a text generation algorithm. When expanding the parent sequence 'The movie was incredibly' with the two most probable next tokens ('good', 'boring'), their code produces the following two new candidate sequences:
- 'The movie was incredibly good'
- 'The movie was incredibly good boring'
Identify the fundamental error in how the second candidate sequence was constructed and describe the correct procedure.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Formula for the Candidate Set in Beam Search
In a text generation process, a single partial sequence is being expanded. The current sequence is 'The sun is shining', and the three most probable next words have been identified as 'brightly', 'today', and 'and'. Based on this information, what will be the new set of candidate sequences to consider for the next step?
Error Analysis in Sequence Expansion
In a text generation process, several partial sequences (parent hypotheses) are being considered. For each parent hypothesis, the three most probable next tokens have been identified. Match each parent hypothesis to its correctly constructed set of new, longer candidate sequences.