Essay

Why a larger model can learn from two image sources

Question: In a concise analytical response, explain why adding a much larger web photo collection can be safe under the stated assumptions, even when the web set is far bigger than the app set.

Sample answer: If the network has enough capacity and is trained long enough on the full mixed dataset, it can fit patterns from both app photos and web photos at the same time. In that case, the fact that one source has many more examples does not create a theoretical problem by itself. Under these conditions, the extra web photos can help rather than hurt performance.

Key points:

  • The model needs enough capacity to represent both sources.
  • Training must continue long enough on the combined data.
  • The model can optimize for both app and web images together.
  • A large imbalance in sample counts does not by itself break the argument.
  • Adding the extra data is expected to improve performance.

Rubric: A strong response mentions both required conditions, explains that the model can learn from both data sources simultaneously, and states that the size imbalance alone does not imply harm.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI