Analyzing Language Model Behavior
Based on the process described in the case study, which modeling approach is being used? Justify your answer by identifying the key characteristic of the process that points to your conclusion.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Analyzing Language Model Behavior
A language model is given the initial text 'The scientist, renowned for groundbreaking work in physics, discovered a new particle that' to use as context for generating a continuation. During the processing of this initial text, the model builds a contextual representation where the understanding of the word 'scientist' is simultaneously informed by the words 'physics' and 'particle'. Which modeling approach is characterized by this specific method of processing the initial context?
Analyzing Context Processing Mechanisms