When are informal bias and variance judgments enough?
Question: Answer in one to three sentences. Make a clear distinction between choosing an action in practice and establishing a mathematical identity.
Sample answer: For making practical decisions on a machine learning project, informal ideas about bias and variance are usually sufficient. Formal definitions are mainly needed when proving the exact error decomposition, and that proof is typically written for mean squared error.
Key points:
- Informal reasoning can guide practical choices.
- Formal notation is used for proofs.
- The exact decomposition is tied to mean squared error.
Rubric: The answer must say that informal bias-variance reasoning is enough for practical decisions and that the formal proof uses mean squared error.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
For which loss can the relationship Total Error = Bias + Variance be derived exactly with formulas?
You must know the exact bias-and-variance formulas before deciding how to make progress on an ML task.
For mean squared error, total error = _____ + variance.
Bias–Variance Ideas and Their Roles
Order the steps for choosing how to treat bias and variance.
When Do Exact Bias–Variance Formulas Matter, and When Is Intuition Enough?
Whether a team must wait for formal bias and variance formulas
When are informal bias and variance judgments enough?
For a developer deciding what to do next in an ML project, which statement is most useful?
With mean squared error, bias and variance can be written as formulas, and the total error decomposes into those parts.