Learn Before
Calculating Prompt Variations from Demonstration Order
A developer has a prompt for a text classification task that includes 4 distinct examples (demonstrations) to guide the model. If the developer decides to create new prompt variations solely by reordering these 4 examples, how many unique prompt sequences can be generated? Explain the mathematical principle that determines this number.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Application in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A developer is using a large language model for a sentiment analysis task. They have a single prompt containing three distinct examples of text paired with their correct sentiment labels. To improve the consistency of the model's predictions, the developer creates two additional prompts by simply rearranging the order of the original three examples. For any new text, they run all three prompts and take the majority vote of the outputs as the final answer. What is the most likely reason for this approach?
Improving LLM Consistency for Code Generation
Calculating Prompt Variations from Demonstration Order