Learn Before
What should a team do after the first experiment makes things worse?
Case context: A team tries one change to improve an image-classification model. The new version performs worse on validation data, and the engineers begin to think the idea was a dead end.
Question: What core lesson about machine learning development are they missing, and what should they do next?
Sample answer: They are missing that machine learning usually improves through repeated cycles of trying ideas, measuring results, and revising the plan. A weak first result does not mean the project has failed. Their next step should be to study what the experiment revealed, use that information to propose a new change, implement it, and run another test.
Key points:
- Progress in ML usually comes from repeated iterations.
- An early bad result is normal.
- The team should learn from the experiment instead of stopping.
- They should return to the idea-code-test loop.
Rubric: The answer should say that early failure is expected and that the team should use the outcome to design and test another idea.
0
1
Tags
D2L
Dive into Deep Learning @ D2L
Machine Learning
Deep Learning
Supervised Learning
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Faster Experiment Cycles Improve Learning Speed
Evaluate Several Model Improvements at the Same Time
Share Machine Learning Lessons With the Team
What three-step cycle best describes a fast machine-learning development loop?
Does the first design you test in an ML project usually become the final solution?
Model Improvement Usually Takes Many Iterations
Match each stage in a simple development cycle with its role.
Put the machine learning improvement cycle in the right order.
Why Machine Learning Development Repeats in Cycles
What should a team do after the first experiment makes things worse?
What should happen after an experiment ends?
What is the main purpose of running a trial in an iterative machine learning workflow?
Must you often test many ideas before finding a workable machine learning solution?