Learn Before
Choosing Appropriate Instruction Formats
Consider two distinct tasks for a pre-trained language model:
Task A: Classifying thousands of customer reviews as 'positive', 'negative', or 'neutral'. Task B: Generating a one-paragraph summary of a complex scientific article, ensuring it highlights the methodology, key findings, and future implications.
For each task, determine whether a concise instruction (e.g., a short prefix like 'Sentiment:') or a comprehensive instruction (a detailed paragraph explaining the requirements) would be more appropriate. Justify your reasoning for each choice.
0
1
Tags
Ch.1 Pre-training - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Acquiring Instruction Knowledge During Pre-training
A developer is using a pre-trained language model for a new task: converting a user's informal description of a meeting into a structured JSON object with 'title', 'date', and 'attendees' keys. Which of the following textual instructions, provided to the model along with the user's description, would be most effective at consistently producing the correct output format?
Enabling Instruction Following via Pre-training
Choosing Appropriate Instruction Formats
Diagnosing and Refining Task Instructions
Universal Language Framework via Textual Inputs