Learn Before
A team of engineers is using a language model to generate code for a complex function. Instead of accepting the first output, they prompt the model five separate times with slight variations in the instructions and then use a voting system to select the most reliable and functional code snippet from the five generated options. Which dimension of inference-time performance is this strategy primarily designed to enhance?
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Integration of Scaling Dimensions in Output Ensembling
A team of engineers is using a language model to generate code for a complex function. Instead of accepting the first output, they prompt the model five separate times with slight variations in the instructions and then use a voting system to select the most reliable and functional code snippet from the five generated options. Which dimension of inference-time performance is this strategy primarily designed to enhance?
Evaluating Inference-Time Scaling Strategies
Match each inference-time strategy with the primary dimension of performance it is designed to enhance, according to a broader definition of scaling.