Question: Explain how a single training error value (e.g., 15%) can lead to two completely different conclusions about a model's bias depending on the optimal error rate.

Sample answer: A training error of 15% alone does not tell us if bias is high or low; we must compare it to the optimal error rate to find the 'avoidable bias'. If the optimal error rate is ~0%, a 15% training error means there is a 15% gap, indicating much room for improvement and suggesting bias-reducing changes will be fruitful. Conversely, if the optimal error rate is 14% due to noisy data, a 15% training error is near perfect. The difference is only 1%, leaving little room for bias-reducing changes to improve performance.

Key points:

• Training error alone is insufficient for bias diagnosis.
• A ~0% optimal error with 15% training error leaves much room for improvement.
• A 14% optimal error with 15% training error leaves little room for improvement.
• The gap determines if bias-reducing changes are fruitful.

Rubric: Answers must correctly explain that bias diagnosis depends on the gap between training and optimal error. They must contrast a scenario with a ~0% optimal error (large gap, fruitful to fix) against a 14% optimal error (small gap, little room to improve).