Learn Before
Concept

Core Issue of Few-Shot Learning

Let H\mathcal{H} be the hypothesis space defined by Few-Shot Learning, h^\hat{h} be the model that minimizes expected risk (which may not be in H\mathcal{H}), hh^{*} be the model in H\mathcal{H} that minimizes expected risk, and hIh_I be the model in H\mathcal{H} that minimizes empirical risk. The total error can be decomposed as: E[R(hI)R(h^)]=E[R(h)R(h^)]+E[R(hI)R(h)]\mathcal{E}[R(h_I) - R(\hat{h})] = \mathcal{E}[R(h^*) - R(\hat{h})] + \mathcal{E}[R(h_I) - R(h^*)] The first term is the Approximation Error, which is determined by the hypothesis space H\mathcal{H}. The second term is the Estimation Error, which is affected by the quantity and quality of the training data. The core issue of few-shot learning is that the small training sample size leads to a high estimation error, resulting in an unreliable empirical minimizer hIh_I.

0

1

Updated 2026-06-14

Tags

Deep Learning (in Machine learning)

Data Science

Computing Sciences