Learn Before
Instruction-Following Ability in LLMs
Evaluating LLM Instruction Adherence
A user provides a large language model with the prompt detailed below. Analyze the model's response based on the instructions given. In your analysis, identify which parts of the instruction the model followed correctly and which parts it failed to follow. Justify your evaluation.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Example of Instruction Following: Summarization
A user provides a language model with the following prompt: 'List the three most common states of matter. Then, in a separate, single sentence, explain why gases do not have a fixed shape.' Which of the following model responses best demonstrates a complete and accurate adherence to the user's instructions?
Evaluating LLM Instruction Adherence
Analyzing an LLM's Instructional Failure
A large language model's ability to accurately execute a command given in a prompt is primarily a direct result of its initial training on a massive dataset of internet text, which teaches it to predict the next word in a sequence.