A language model is processing an input where numbers dictate the prediction order: The4 quick1 brown3 fox2 jumps5 .. When the model is about to predict the word corresponding to the number '3', what information from the sentence is available to it as context?
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is being trained using a technique where the order of words to be predicted is shuffled. Given the input
A4 quick1 brown3 fox2 jumps5 ., what is the correct sequence for predicting the first four words?A language model is presented with the following input, where each word is paired with a number indicating its prediction order:
The5 quick2 brown4 fox1 jumps3 .. Arrange the words in the order they should be predicted by the model.A language model is processing an input where numbers dictate the prediction order:
The4 quick1 brown3 fox2 jumps5 .. When the model is about to predict the word corresponding to the number '3', what information from the sentence is available to it as context?