A key development leading to modern large-scale language models was the adoption of a pre-training paradigm. How did the influential pre-training approach that became standard in computer vision fundamentally differ from the self-supervised approach that now dominates natural language processing?

Arrange the following key developments in the history of pre-training into the correct chronological and influential sequence, from the earliest concept to the modern paradigm.

Converging Histories of Pre-training

Divergent Pre-training Paradigms in NLP and Computer Vision

Self-Supervised Pre-training of Language Models