Learn Before
Evaluating a Prompt Ensemble Strategy
A team is tasked with creating a one-paragraph, neutral summary of a controversial political event using a single language model. To improve the robustness of their output, they use the following three prompts and plan to combine the resulting summaries:
- 'Summarize the attached article about the political event.'
- 'Provide a summary of the provided text concerning the political event.'
- 'Create a brief synopsis of the article about the political event.'
Critique this approach. Explain why this strategy is unlikely to achieve the desired outcome of a more robust and high-quality summary, and propose a specific change to their set of prompts that would be more effective.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A research team is using a single large language model to generate a balanced and comprehensive summary of a complex, multi-perspective news article. To improve the quality of the final output, they decide to generate several different responses and combine them. Which set of prompts is most likely to produce the varied outputs needed for a high-quality, aggregated summary?
Diagnosing Ineffective Prompt Combination
Evaluating a Prompt Ensemble Strategy