Accuracy Is Not Always the Right Metric

Using a Strong Penalty for a Critical Error Type

Set a New Evaluation Goal When the Current Metric Is Unreliable

What should a team do if its evaluation metric is rewarding the wrong outcome?

If an evaluation metric does not reflect the real project goal, it is still reliable for choosing the best model.

A score that measures the wrong target should not be used to ____ the best model.

Match each metric concept to its description.

What should a team do after noticing its metric points to the wrong goal?

What to do when an evaluation score favors the wrong goal

Diagnose a metric mismatch in a fraud detection model selection process.

What should a team do if its metric does not match the real objective?

What happens when an evaluation metric tracks the wrong goal?

A team should replace an evaluation metric that no longer reflects the project goal.