The process of adapting a pre-trained language model using a dataset of instructions and their corresponding desired outputs is categorized as an alignment problem because its primary goal is to enhance the model's core linguistic knowledge and predictive accuracy.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Classification of LLM Fine-Tuning Approaches for Reasoning Tasks
A development team is updating a pre-trained language model by further training it on a curated dataset of specific prompts and their desired, high-quality outputs (e.g., prompt: 'Explain gravity to a 5-year-old,' output: 'Gravity is like a big, invisible hug from the Earth...'). Why is this specific training process considered a method for model alignment?
Evaluating the Purpose of Instruction-Based Training
The process of adapting a pre-trained language model using a dataset of instructions and their corresponding desired outputs is categorized as an alignment problem because its primary goal is to enhance the model's core linguistic knowledge and predictive accuracy.