Learn Before
Example of Instruction Following: Summarization
Text summarization is a common task that demonstrates the instruction-following ability of Large Language Models. A typical prompt for this task, often denoted as x, is composed of an instruction and a user input. For example, a prompt might be structured with an instruction like 'Summarize the following article,' which is then followed by the article text that serves as the user input. The model's objective is to adhere to the instruction and generate a concise summary of the provided document.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Related
Example of Instruction Following: Summarization
A user provides a language model with the following prompt: 'List the three most common states of matter. Then, in a separate, single sentence, explain why gases do not have a fixed shape.' Which of the following model responses best demonstrates a complete and accurate adherence to the user's instructions?
Evaluating LLM Instruction Adherence
Analyzing an LLM's Instructional Failure
Necessity of Tuning for Instruction Following
Prompting Without Structural Adaptation
Learn After
Example of a Summarization Prompt with a Sentence Constraint
A user provides a language model with the following prompt, which includes an instruction and a text passage. Based on the model's response, which statement best analyzes its performance in following the given instruction?
Instruction: 'Summarize the following text.'
Text: 'The water cycle describes the continuous movement of water on, above, and below the surface of the Earth. The main processes involved are evaporation, where water turns into vapor; condensation, where vapor forms clouds; precipitation, where water falls back to Earth as rain or snow; and collection, where water gathers in bodies like oceans and rivers. This cycle is crucial for sustaining life.'
Model's Response: 'The water cycle is a vital process involving evaporation, condensation, precipitation, and collection, which describes the continuous movement of water throughout the Earth's systems.'
Diagnosing a Failed Summarization Attempt
Examples of Constrained Prompts for Text Summarization
Constructing a Summarization Prompt