Choosing an ML strategy for a new prediction task.
Case context: A logistics startup is building a model to predict which delivery vans will need maintenance soon. The engineering lead wants to spend two months trying to prove, on paper, the single best model class before collecting any baseline results.
Question: As a machine learning consultant, what is the weakness in this plan, and what should the team do instead?
Sample answer: The weakness is assuming the best solution can be identified reliably before any experiments are run. For a new machine learning task, the right model choices are usually not obvious in advance, so the team should avoid long theoretical delays. A better plan is to build a simple baseline quickly, measure it on real data, and then improve it through repeated experiments.
Key points:
- The best approach for a new ML problem usually cannot be known in advance.
- Early experimentation is more useful than months of speculation.
- A baseline system should be built first, then refined with data-driven iteration.
Rubric: The response must identify the flaw as overconfidence in preselecting the optimal method and recommend starting with a baseline and iterating based on measured results.
0
1
Tags
D2L
Dive into Deep Learning @ D2L
Machine Learning
Deep Learning
Supervised Learning
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Why do ML teams usually test several approaches on a new problem?
The Best ML Approach Is Usually Obvious Before Testing
For a brand-new machine learning task, it is usually _____ to know beforehand which method will work best.
Match Each Situation to the Correct Machine Learning Idea
Order the stages of a typical iterative machine learning workflow when the best solution is not obvious.
How many candidate ideas does an experienced ML practitioner often test before finding a good solution?
Choosing the best ML approach before any experiments is easy for experienced teams and mainly difficult for beginners.
What do teams often test many of before finding a workable machine-learning approach?
Match each development claim to its implication.
Put the reasoning in order for why ML work usually proceeds by iteration.
Why Machine Learning Requires Repeated Experimentation
Choosing an ML strategy for a new prediction task.
Can experts predict the best ML approach in advance?