Critique of a Model Scaling Strategy
As a consultant reviewing the plan described in the case study, what is the primary flaw in the project lead's strategy for improving the model's performance on novel, qualitatively different tasks? Justify your evaluation.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
An AI development team observes that their language model, which has been trained on a large dataset of specific instructions, performs poorly on novel tasks it has never encountered before. To improve its ability to generalize, the team proposes to significantly increase the volume of their training data by adding many more examples of the same types of instructions. Which statement provides the most accurate evaluation of this strategy's efficiency for achieving better generalization?
Critique of a Model Scaling Strategy
Evaluating Scaling Strategies for Model Generalization
Limitations of Supervised Fine-Tuning for LLM Alignment