Why is defining a new team goal with a replacement metric preferred over manual classifier selection?
Question: When a team's evaluation metric is no longer trusted, why does Andrew Ng recommend picking a new metric to define a new team goal rather than manually selecting classifiers?
Sample answer: Andrew Ng recommends this because proceeding without a trusted metric leads to manually choosing among classifiers, which hinders long-term progress. A new trusted metric explicitly defines a clear, shared goal for the team to work toward efficiently.
Key points:
- Prevents the team from proceeding too long without a trusted metric.
- Avoids reverting to manual classifier selection.
- Explicitly defines a new goal for the team.
Rubric: Answer should state that a new metric defines a clear team goal and avoids the inefficiency of manual classifier selection.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Related
When an ML team's evaluation metric is no longer trusted, what does Andrew Ng strongly recommend?
True or False: Andrew Ng considers it acceptable for a team to proceed for an extended period without a trusted metric by manually selecting among classifiers.
When a metric is no longer trusted, Andrew Ng recommends picking a new _____ to explicitly define a new goal for the team.
What does Andrew Ng recommend when a metric is no longer trusted?
It is acceptable to proceed for a long time without a trusted metric by manually choosing among classifiers.
Andrew Ng recommends picking a new _____ to explicitly define a new team goal when the current one is untrustworthy.
Match each concept to its role when a project metric becomes untrustworthy.
Order the steps for recovering from an untrustworthy metric per Andrew Ng's recommendation.
What is the main purpose of using a replacement metric to explicitly define a new team goal?
When a metric becomes untrustworthy, Andrew Ng's recommended first action is to immediately halt all model training.
Ng advises against proceeding for too long without a trusted metric and _____ to manually choosing among classifiers.
Match each team behavior to its consequence when a project metric is untrustworthy.
Order the reasoning steps that justify replacing an untrustworthy metric rather than using manual classifier selection.
How does establishing a new trusted metric prevent issues associated with manually choosing classifiers during model selection?
How should an ML team handle evaluation when their main metric is found to be untrustworthy?
Why is defining a new team goal with a replacement metric preferred over manual classifier selection?