Learn Before
Explaining a Pre-Training Supervision Method
Imagine a language model is being pre-trained by being integrated into a larger system designed to classify customer reviews as either 'positive' or 'negative'. In your own words, describe the primary source of the supervision signal that guides the language model's learning in this scenario.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Comprehension in Revised Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A research team is pre-training a language model. They integrate this model as a component within a larger system designed to classify news articles into categories like 'Sports', 'Technology', or 'Politics'. The language model's internal parameters are updated based on the entire system's success in correctly categorizing the articles. Which statement best analyzes the fundamental principle of this training methodology?
Optimizing a Sentiment Analysis Model
Explaining a Pre-Training Supervision Method
Sentence Comparison in Discriminative Training
Token Classification in Discriminative Training