Learn Before
A machine translation system generates an output sentence one word at a time, where each new word is chosen based on the original input sentence and the words already generated. When translating a long, complex sentence, the system produces an output that starts accurately but then devolves into a repetitive, nonsensical phrase (e.g., '...the boy is going to the is going to the is going to the...'). What is the most likely flaw in the generation process that would cause this specific type of error?
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A machine translation system generates an output sentence one word at a time, where each new word is chosen based on the original input sentence and the words already generated. When translating a long, complex sentence, the system produces an output that starts accurately but then devolves into a repetitive, nonsensical phrase (e.g., '...the boy is going to the is going to the is going to the...'). What is the most likely flaw in the generation process that would cause this specific type of error?
A machine translation model is translating the English sentence 'The cat sat' into French. It has already generated the tokens 'Le' and 'chat'. Arrange the following actions in the correct order to generate the very next token in the sequence.
Explaining Divergent Translations