Learn Before
Evaluating a Model Training Strategy
Based on the scenario provided, evaluate the lead engineer's proposed training strategy. What is the most significant risk of training a model exclusively on a small, specialized dataset from scratch? Explain the primary benefit the model would gain if it were first trained on a vast, unlabeled corpus of general text before being trained on the specialized legal data.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Evaluating a Model Training Strategy
A research team wants to build a model that can summarize news articles. Arrange the following high-level steps of the model's training process into the correct chronological order.
A development team is building a text-to-text model. They have just completed the first stage of training, where the model was exposed to a massive, unlabeled dataset from the internet. What is the most likely reason they would now proceed to a second stage of training using a smaller, curated dataset of specific input-output pairs?