Learn Before
Analyzing and Correcting Instruction-Following Failures
A user provided the following prompt to a language model:
Prompt: 'Describe three key features of a modern smartphone. Present your answer as a numbered list. Each point must be a complete sentence and contain no more than 12 words. Do not mention the brand of any phone.'
Model's Response:
- High-resolution cameras for stunning photos.
- The iPhone has a powerful processor for fast performance.
- Long battery life and fast charging capabilities.
Identify one specific instruction from the prompt that the model failed to follow. Then, rewrite the corresponding part of the model's response to make it compliant with that instruction.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Evaluating an LLM's Instruction-Following Performance
A language model was given the following text and a specific set of instructions. Analyze the four responses below and identify which one demonstrates the best ability to follow all the given instructions.
Text: 'Solar energy is a renewable power source derived from the sun's radiation. It offers a significant advantage by reducing greenhouse gas emissions, which is crucial for combating climate change. Furthermore, solar panels can be installed on rooftops, making use of otherwise unused space and potentially lowering electricity bills for homeowners. The technology is continually improving, becoming more efficient and affordable.'
Instructions: 'Summarize the provided text in exactly three bullet points. Each bullet point must be a complete sentence and start with the phrase "The key takeaway is". Do not use the word "significant".'
Analyzing and Correcting Instruction-Following Failures