Learn Before
A team is developing prompts for a text summarization task. They provide annotators with examples of source texts and their corresponding high-quality summaries. Despite this, the prompts created by different annotators are inconsistent in their phrasing and structure, causing the language model to produce summaries of varying quality. What is the most critical element missing from their prompt creation management process?
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Evaluating a Prompt Generation Workflow
A team is developing prompts for a text summarization task. They provide annotators with examples of source texts and their corresponding high-quality summaries. Despite this, the prompts created by different annotators are inconsistent in their phrasing and structure, causing the language model to produce summaries of varying quality. What is the most critical element missing from their prompt creation management process?
Designing Annotation Guidelines for Prompt Creation