Evaluating Reconstruction Difficulty
A language model is trained to reconstruct original sentences from their shuffled words. Consider the following two shuffled inputs:
Input 1: quick the fox brown lazy the over jumps dog
Input 2: police the police that police the police police
Evaluate which input would likely be more difficult for the model to reconstruct into a grammatically correct and meaningful sentence. Justify your reasoning by comparing the properties of the two inputs.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is given a training task where it must reconstruct the original, grammatically correct sentence from a version where all the words and punctuation have been randomly shuffled. If the model receives the input sequence
ate mouse cheese the The ., which of the following is the correct output it should produce?Learning Objectives of a Sentence Reconstruction Task
Evaluating Reconstruction Difficulty