Learn Before
Computational Scale as a Driver of Deep Learning Progress
Computational scale is a major driver of recent deep learning progress because it makes it possible to train neural networks large enough to take advantage of huge datasets.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Data Availability as a Driver of Deep Learning Progress
Computational Scale as a Driver of Deep Learning Progress
Older Learning Algorithms Can Plateau with More Data
Large Neural Networks Benefit from Huge Data
Small Data Regime Can Favor Hand-Engineered Features
According to Andrew Ng, what are the two biggest drivers of recent deep learning progress?
True or False: Neural network ideas are a brand-new invention of the last decade.
Two of the biggest drivers of recent progress have been data availability and _____.
Match each driver of deep learning progress to its correct description.
Order the reasoning steps explaining why deep learning is taking off now.
Explain why decades-old deep learning ideas are only now driving major progress.
Diagnose why a company's old algorithm and new neural network perform differently as data grows.
In one to two sentences, why might a small dataset favor hand-engineered features over a large neural network?
Which statement best reflects the relationship between deep learning ideas and their timing of impact?
True or False: Data availability and computational scale are described as the two biggest drivers of recent deep learning progress.
Learn After
What does computational scale primarily enable in deep learning according to Machine Learning Yearning?
Computational scale enables training neural networks large enough to take advantage of huge datasets.
Computational scale drives deep learning progress because it enables training neural networks large enough to take advantage of _____ datasets.
Match each term to its role in explaining why computational scale drives deep learning progress.
Order the reasoning steps that explain how computational scale leads to improved deep learning performance.
According to Machine Learning Yearning, how recently did it become possible to train neural networks large enough to exploit huge datasets?
Computational scale alone, without large datasets, is sufficient to drive recent deep learning progress.
Machine Learning Yearning (p. 9): 'We started just a few years ago to be able to train neural networks that are _____ enough to take advantage of the huge datasets we now have.'
Match each factor to the specific bottleneck it overcomes in enabling modern deep learning progress.
Order the steps a practitioner would follow when applying the insight that computational scale drives deep learning progress.
Analyzing the Relationship Between Computational Scale and Large Datasets
Scaling Decision for Deep Learning with Massive Datasets
The Role of Computational Scale in Utilizing Huge Datasets