Evaluating the Strategy of Increasing Model Capacity
A common approach to improve a language model's ability to process very long documents is to significantly increase its internal capacity for storing information. Critically evaluate this strategy. In your response, explain the primary benefit of this approach and discuss at least two potential drawbacks or challenges that might arise from implementing it.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A team is developing a language model to write detailed summaries of entire novels. They observe that the model's summaries are often incoherent and fail to mention key characters and events from the first few chapters. To solve this, the team wants to apply a strategy that directly increases the model's capacity to handle the full context. Which of the following actions best implements this specific strategy?
Evaluating the Strategy of Increasing Model Capacity
Troubleshooting a Chatbot's Memory