Essay

Explain why formal and informal bias–variance treatments can serve different purposes.

Question: In a concise analytical response, contrast the role of formulas under mean squared error with the role of informal definitions in guiding ML progress.

Sample answer: When the error metric is mean squared error, formulas can specify bias and variance and support a proof that Total Error = Bias + Variance. However, if the purpose is to decide how to make progress on an ML problem, the source says the informal definitions are sufficient. Thus, the appropriate treatment depends on whether the goal is formal proof or practical decision-making.

Key points:

  • Mean squared error permits formula-based specifications of bias and variance.
  • The formulas support proving Total Error = Bias + Variance.
  • Informal definitions suffice for deciding how to progress on an ML problem.
  • The required level of formality depends on the purpose.

Rubric: A strong response accurately identifies mean squared error as the setting for the formula-based proof, states the total-error equality, explains that informal definitions suffice for progress decisions, and clearly contrasts the two purposes.

0

1

Updated 2026-07-19

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI