Learn Before
Distinguishing Learned vs. Emergent Skills
A large language model is trained exclusively on a vast corpus of text from encyclopedias and historical documents. After training, it demonstrates two new skills: (1) It can accurately answer factual questions about historical events mentioned in its training data. (2) It can write short, rhyming poems about those same historical events, despite having no poetry in its training set. Which of these two skills is a better example of an emergent ability, and why? Justify your reasoning.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Emergent Abilities as Evidence for the Efficacy of Scaled Training
A research team trains a series of language models, each with an increasing number of parameters, on the same large dataset. They evaluate each model on several different tasks. Which of the following outcomes would be the clearest example of an emergent ability?
Evaluating a New Model Capability
Distinguishing Learned vs. Emergent Skills