Learn Before
Evaluating the Limits of Scaling
The prevailing strategy for improving the capabilities of large language models has been to increase their size and the amount of data they are trained on. Analyze why this approach, while effective, is widely considered insufficient on its own to achieve Artificial General Intelligence (AGI). In your response, describe at least two distinct challenges or missing capabilities that this strategy does not address.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
An AI research lab announces its strategy to achieve Artificial General Intelligence (AGI) is based on a single principle: building a language model 100 times larger than any current model and training it on a proportionally larger dataset. Which of the following statements provides the most accurate evaluation of this 'scaling-only' approach?
Evaluating the Limits of Scaling
Critique of a Scaling-Centric AGI Strategy