Diagnosing Issues in Instruction Inference
A developer wants an LLM to generate the instruction: 'Classify the sentiment of the text as Positive, Negative, or Neutral.' They provide the LLM with the following input-output examples to infer this instruction:
- Input: 'I love this new phone!' -> Output: 'Good'
- Input: 'The service was terrible.' -> Output: 'Bad'
- Input: 'The movie was okay, I guess.' -> Output: 'Fine'
However, the LLM generates a vague instruction like 'Analyze the text provided.' Analyze the developer's examples and explain the most likely reason for this outcome. Then, suggest a specific improvement to the output examples to help the LLM generate the desired instruction.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Example of a Prompt Template for Generating Instructions from Input-Output Pairs
Instruction Inference from Input-Output Pairs
A developer wants a language model to generate a clear instruction for the task of 'summarizing a long paragraph into a single, concise sentence.' To do this, they will provide the model with a set of input-output examples and ask it to infer the instruction. Which of the following sets of examples is most likely to result in the desired instruction?
Diagnosing Issues in Instruction Inference
Crafting Examples for Instruction Inference