Learn Before
Justifying the Pruning Step in Prompt Optimization
Imagine you are trying to find the most effective instruction for a language model to perform a specific task. You have generated 100,000 different candidate instructions. The full evaluation process, which measures the performance of each instruction, is very slow and computationally expensive. Explain the primary reason for implementing a preliminary, fast filtering step to discard a large number of these candidates before conducting the full evaluation.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Comprehension in Revised Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Score-based Pruning of Prompts
A team is developing a system to find the best instructions for a language model on a complex task. They have generated 50,000 different candidate instructions. The full evaluation process for each candidate is computationally intensive and expensive. An engineer proposes implementing a preliminary, less accurate, but very fast filtering step to discard 95% of the candidates before the full, expensive evaluation begins. Which of the following statements best evaluates the primary trade-off of this proposal?
Resource-Constrained Prompt Optimization
Justifying the Pruning Step in Prompt Optimization