Learn Before
Critique of a Sampling Strategy for Instruction Generation
A machine learning engineer argues, "To generate the most creative and novel instructions for a language model, the best strategy is to always select the most semantically diverse and dissimilar tasks from the existing pool to use as in-context examples." Critically evaluate this argument. In your response, discuss at least one potential advantage and one significant disadvantage of this proposed strategy.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Instruction Generation in Self-Instruct
A team is developing a system to automatically generate new instructional tasks for a large language model. The system works by first selecting a few existing tasks from a large pool to serve as examples. In one run, the system selects three examples that are all variations of the same task: 'Sort a list of integers in ascending order.' What is the most probable outcome when these highly similar examples are used to prompt the model to generate a new instruction?
Critique of a Sampling Strategy for Instruction Generation
Diagnosing a Flaw in an Instruction Generation Pipeline