Essay

Why long-standing deep learning ideas became effective recently

Question: In a concise essay, explain why ideas such as neural networks have existed for a long time but only recently began producing major practical gains.

Sample answer: Core deep learning ideas are not new; researchers have studied them for many years. What changed was the environment around them. Two major enabling factors made the ideas work well at scale: much larger amounts of labeled data became available, and much more computational power became accessible for training larger models. Once those two constraints loosened, older methods could finally be trained effectively and produce strong results in real applications.

Key points:

  • The underlying ideas are old
  • Progress comes from more data and more computing power
  • The two factors work together to make larger, better-trained models possible
  • This explains the recent rise in practical impact

Rubric: Full credit requires stating that the ideas are longstanding, naming both data availability and computational scale as the drivers, and explaining how the two together enabled the recent progress. Partial credit for identifying only one driver or leaving out the historical context.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

D2L

Dive into Deep Learning @ D2L

Deep Learning

Data Science

Machine Learning

Supervised Learning

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI