Learn Before
Explain why decades-old deep learning ideas are only now driving major progress.
Question: In a concise essay, explain the relationship between the age of deep learning ideas and the recent surge in their real-world impact, referencing the two drivers Ng identifies.
Sample answer: Deep learning's core ideas, such as neural networks, have existed for decades but lacked the resources to reach their potential. Recent progress is not due to new theoretical breakthroughs but to two enabling factors: data availability, meaning far more labeled data now exists to train models, and computational scale, meaning far more processing power is available to train larger models on that data. Together, these two factors allowed old ideas to finally demonstrate strong performance, explaining why deep learning is 'taking off now' rather than decades ago.
Key points:
- Deep learning ideas are decades old
- Progress is driven by data availability and computational scale, not new ideas
- Both factors work together to enable performance gains
- This explains why deep learning is only now taking off
Rubric: Full credit requires identifying that the ideas are old, naming both data availability and computational scale as drivers, and explaining how their combination enabled progress. Partial credit for naming only one driver or omitting the historical context.
0
1
Tags
D2L
Dive into Deep Learning @ D2L
Deep Learning
Data Science
Machine Learning
Supervised Learning
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Data Availability as a Driver of Deep Learning Progress
Computational Scale as a Driver of Deep Learning Progress
Older Learning Algorithms Can Plateau with More Data
Large Neural Networks Benefit from Huge Data
Small Data Regime Can Favor Hand-Engineered Features
According to Andrew Ng, what are the two biggest drivers of recent deep learning progress?
True or False: Neural network ideas are a brand-new invention of the last decade.
Two of the biggest drivers of recent progress have been data availability and _____.
Match each driver of deep learning progress to its correct description.
Order the reasoning steps explaining why deep learning is taking off now.
Explain why decades-old deep learning ideas are only now driving major progress.
Diagnose why a company's old algorithm and new neural network perform differently as data grows.
In one to two sentences, why might a small dataset favor hand-engineered features over a large neural network?
Which statement best reflects the relationship between deep learning ideas and their timing of impact?
True or False: Data availability and computational scale are described as the two biggest drivers of recent deep learning progress.