Choosing a Model Adaptation Strategy

A development team needs to adapt a large, pre-trained language model for a new, specific task: classifying short user reviews. They have limited time and computational budget. Why is adapting the model by providing a few classification examples directly within the input prompt generally a more efficient strategy than initiating a new training process to update the model's parameters with the new data?

The Core of In-Context Learning Efficiency