An evaluator is given two customer service agent responses to a user who is upset that a software feature has stopped working. The evaluator's task is to choose the better response.
- Response A: "We know about the bug. It will be fixed in the next update."
- Response B: "I understand how disruptive it can be when a feature you rely on stops working. I've reported this to our engineering team as a priority, and I'll let you know as soon as I have an update for you."
The evaluator marks "Response B is preferred." Which of the following best explains the reasoning behind this evaluation?
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
An evaluator is given two customer service agent responses to a user who is upset that a software feature has stopped working. The evaluator's task is to choose the better response.
- Response A: "We know about the bug. It will be fixed in the next update."
- Response B: "I understand how disruptive it can be when a feature you rely on stops working. I've reported this to our engineering team as a priority, and I'll let you know as soon as I have an update for you."
The evaluator marks "Response B is preferred." Which of the following best explains the reasoning behind this evaluation?
Evaluating Customer Service Responses for Empathy
An evaluator is comparing two responses to a customer's complaint. Match each statement below to the category that best describes how it would likely be judged in a preference evaluation.