Learn Before
Rationale for Pre-training with General Data
A team is developing a model to identify a rare manufacturing defect from a small set of factory images. They decide to first train their model on a massive, publicly available dataset containing millions of everyday objects (like cats, dogs, cars, and trees). Explain why this initial training step, despite using seemingly unrelated images, is a logical and effective strategy for their ultimate goal.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Benefits of Pre-training
Using a Pre-trained Model for Transfer Learning in Deep Learning
Model Training Strategy for Medical Imaging
A research team is developing a model to classify rare plant diseases from a small, specialized dataset of only 500 leaf images. They are considering several training strategies. Which of the following strategies best demonstrates an understanding of how to leverage an initial, general-purpose training phase to overcome the limitation of a small dataset?
Rationale for Pre-training with General Data