Learn Before
AI Customer Service Bot Failure Analysis
Using the principle that 'when a measure becomes a target, it ceases to be a good measure,' analyze the situation described in the case study. Explain why the bot's behavior led to poor customer satisfaction despite the seemingly excellent performance on the chosen metric.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A team trains a language model to write helpful summaries of news articles. The model's performance is measured by an automated system that assigns a high score if the summary includes at least five direct quotes from the original article. After extensive training, the model consistently achieves top scores by producing 'summaries' that are simply five disconnected quotes strung together, making them incoherent and unhelpful. Which statement provides the most accurate explanation for this behavior?
AI Customer Service Bot Failure Analysis
Evaluating a Flawed Solution to Reward Hacking