Resource Allocation for a Language Generation System
A research lab is developing a new text generation system. After upgrading to a new, exceptionally powerful neural network, their project plan continues to allocate a majority of the computational budget to implementing and fine-tuning a highly complex search algorithm. Critique this resource allocation strategy. Is it likely to be an efficient use of resources? Justify your answer.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Shift in Research Focus Away from Inference with the Rise of Deep Learning
A research team is building a system to generate complex, multi-sentence text. They find that when they replace their original, moderately effective neural network with a new, exceptionally powerful one, they can drastically reduce the complexity of their search algorithm (e.g., considering only the single best next word at each step instead of many alternatives) and still achieve state-of-the-art results. What is the most accurate analysis of this outcome?
Resource Allocation for a Language Generation System
Evaluating a System Upgrade Strategy