Learn Before
Evaluating LLM Instruction Adherence
A user provides a large language model with the prompt detailed below. Analyze the model's response based on the instructions given. In your analysis, identify which parts of the instruction the model followed correctly and which parts it failed to follow. Justify your evaluation.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Example of Instruction Following: Summarization
A user provides a language model with the following prompt: 'List the three most common states of matter. Then, in a separate, single sentence, explain why gases do not have a fixed shape.' Which of the following model responses best demonstrates a complete and accurate adherence to the user's instructions?
Evaluating LLM Instruction Adherence
Analyzing an LLM's Instructional Failure
Necessity of Tuning for Instruction Following
Prompting Without Structural Adaptation