Analyzing Context for Word Prediction
Consider the sentence: The tired hiker finally reached the [M] and took a long drink. Provide two different, plausible words that could fill in the masked token [M], and for each word, identify the specific contextual clue(s) from the sentence that support your prediction.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is tasked with predicting the masked word, represented by
[M], in the sentence: 'The librarian placed the overdue [M] back on the shelf.' Based on an analysis of the surrounding words, which of the following options is the most probable prediction?A language model is tasked with predicting the masked word
[M]in the two sentences below. Analyze the surrounding words in each sentence.Sentence 1:
The skilled mechanic quickly repaired the [M] with a new part.Sentence 2:He saw the [M] over there.Which sentence provides a more constrained and helpful context for the model to make an accurate prediction, and why?
Analyzing Context for Word Prediction