Question: In a concise analytical response, explain how human-level performance helps a team diagnose its algorithm and make faster progress.

Sample answer: Human-level performance provides a reference for estimating the optimal error rate and setting a desired error rate. A reasonable, achievable target can accelerate progress by giving the team a practical objective. Comparing the algorithm with this reference can also reveal high avoidable bias. That diagnosis is valuable because it opens a menu of improvement options. For tasks people do well, development is further supported by accessible human labels and human intuition during error analysis.

Key points:

• Human-level performance helps estimate optimal error.
• It helps establish a desired error rate.
• A reasonable and achievable target accelerates team progress.
• High avoidable bias opens improvement options.
• Human labels and intuition make development easier on human-solvable tasks.

Rubric: A strong response accurately connects human-level performance to optimal and desired error rates, explains why an achievable target accelerates progress, and links high avoidable bias to improvement options. It may also mention labeling and human-guided error analysis.