A language model is pre-trained on a task where it must determine if two sentences are consecutive in a text. When presented with the pair: 'The children went to the river bank to skip stones.' and 'The First National Bank offers competitive loan rates.', the model incorrectly classifies them as consecutive. Which of the following best explains why the model made this specific error?
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is pre-trained on a task where it must determine if two sentences are consecutive in a text. When presented with the pair: 'The children went to the river bank to skip stones.' and 'The First National Bank offers competitive loan rates.', the model incorrectly classifies them as consecutive. Which of the following best explains why the model made this specific error?
Diagnosing Flawed Model Behavior
Critique of a Pre-training Task Design