Learn Before
Shift from Fine-Tuning to Prompting with Pre-trained Models
The widespread adoption of modern prompting began with the emergence of large pre-trained models like BERT. Initially, adapting these models for specific downstream tasks was primarily done through fine-tuning. However, researchers discovered that by adding specific words or sentences as 'prompts' to the input, models could be guided to perform tasks effectively without requiring extensive fine-tuning.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Ch.3 Prompting - Foundations of Large Language Models
Related
Historical Antecedents of Prompting
Shift from Fine-Tuning to Prompting with Pre-trained Models
Demonstration of Prompting's Power with Large-Scale Models
The Interplay Between Model Advancement and Interaction Methods
Which of the following statements best analyzes the co-evolutionary relationship between the increasing scale of language models and the emergence of prompting as a key technology in Natural Language Processing?
Emergence of Prompt Engineering as a Research Field
Arrange the following key developments in the relationship between language models and user interaction into the correct chronological order, from earliest to most recent.
Learn After
Prompting as a Motivator for Universal Foundation Models
A research team has a large, pre-trained language model designed for general text understanding. Initially, to make this model perform a specific task like classifying emails as 'spam' or 'not spam', they had to collect thousands of labeled emails and use them to update the model's internal parameters. This process was resource-intensive. Subsequently, a new approach was discovered that achieved similar results with far less effort. Which statement best analyzes the core principle of this more efficient new approach?
Evaluating Model Adaptation Strategies for a Specialized Task
Recommending an Adaptation Strategy for a Legal Tech Startup