Sentence Probability Comparison
An auto-regressive language model has processed the beginning of a sentence, 'The dog chased the'. It needs to determine which of two possible continuations is more probable. Using the conditional probabilities provided in the case study, calculate the probability of each continuation and identify which full sentence the model would consider more likely. You can assume the probability of the initial phrase 'The dog chased the' is a constant factor for both options and does not need to be included in your final calculation.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
An auto-regressive language model calculates the probability of a sequence of words one step at a time, where each step depends on the words that came before it. Arrange the following calculations in the correct order that such a model would use to determine the total probability of the sentence 'The cat sat.'
An auto-regressive language model is tasked with calculating the total probability of the sentence 'The quick brown fox'. According to the principles of sequential probability calculation, which of the following expressions correctly represents the probability of the word 'brown' at its specific position in the sentence?
Sentence Probability Comparison