Evaluating Sentence Probability
A team is using a language model, pre-trained on a vast corpus of general English text, to evaluate the likelihood of different sentences. They input two grammatically correct sentences into the model to calculate their overall probability. Based on the fundamental principle of how these models compute probabilities, which sentence would be assigned a higher overall probability, and why?
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Inference Process with a Fine-Tuned Model
Probability Distribution Formula for an Encoder-Softmax Language Model
A language model has been trained on a large corpus of English text. When given the sentence 'The chef carefully seasoned the soup with a pinch of ____.', which of the following best represents the direct output the model calculates for the blank position?
Evaluating Sentence Probability
Impact of Training Data on Probability