logo
How it worksCoursesResearch CommunitiesBenefitsAbout Us
Schedule Demo
Learn Before

  • Instruction-Following Ability in LLMs

Example of Instruction Following: Summarization

Text summarization is a common task that demonstrates the instruction-following ability of Large Language Models. A typical prompt for this task, often denoted as x, is composed of an instruction and a user input. For example, a prompt might be structured with an instruction like 'Summarize the following article,' which is then followed by the article text that serves as the user input. The model's objective is to adhere to the instruction and generate a concise summary of the provided document.

0

1

6 months ago

Contributors are:

Gemini AI
Gemini AI
🏆 9

Who are from:

Google
Google
🏆 9

References

Tags

Ch.4 Alignment - Foundations of Large Language Models

Foundations of Large Language Models

Computing Sciences

Foundations of Large Language Models Course

Related

  • Example of Instruction Following: Summarization

  • A user provides a language model with the following prompt: 'List the three most common states of matter. Then, in a separate, single sentence, explain why gases do not have a fixed shape.' Which of the following model responses best demonstrates a complete and accurate adherence to the user's instructions?

  • Evaluating LLM Instruction Adherence

  • Analyzing an LLM's Instructional Failure

Learn After

  • Example of a Summarization Prompt with a Sentence Constraint

  • A user provides a language model with the following prompt, which includes an instruction and a text passage. Based on the model's response, which statement best analyzes its performance in following the given instruction?

    Instruction: 'Summarize the following text.'

    Text: 'The water cycle describes the continuous movement of water on, above, and below the surface of the Earth. The main processes involved are evaporation, where water turns into vapor; condensation, where vapor forms clouds; precipitation, where water falls back to Earth as rain or snow; and collection, where water gathers in bodies like oceans and rivers. This cycle is crucial for sustaining life.'

    Model's Response: 'The water cycle is a vital process involving evaporation, condensation, precipitation, and collection, which describes the continuous movement of water throughout the Earth's systems.'

  • Diagnosing a Failed Summarization Attempt

  • Examples of Constrained Prompts for Text Summarization

  • Constructing a Summarization Prompt