Critiquing a Model Training Hypothesis
A colleague argues, "The fine-tuning process is where a large language model learns all of its useful, task-specific abilities from scratch. The pre-training phase is just a preliminary step to get the model to understand basic language structure." Evaluate the validity of this statement. In your evaluation, explain the relationship between the knowledge acquired during pre-training and the capabilities demonstrated after fine-tuning.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Ch.4 Alignment - Foundations of Large Language Models
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Fine-Tuning Pre-trained Models for Downstream Tasks
Instruction Fine-Tuning
Superficial Alignment Hypothesis
Challenge of Opaque Pre-Training Data in Fine-Tuning
A team develops a large language model pre-trained on a massive, diverse corpus of text from the internet. When initially tested on the task of generating concise summaries of legal documents, its performance is poor and unstructured. The team then collects a small, curated dataset of 500 legal documents and their corresponding expert-written summaries. After training the model on this small dataset, its ability to summarize new legal documents improves dramatically. Which statement best analyze
Critiquing a Model Training Hypothesis
Implicit Learning of Instruction-Response Mappings During Pre-training
Explaining the Impact of Targeted Training