Diagnosing a Fine-Tuning Data Issue
A development team has fine-tuned a language model to perform a single task: summarizing news articles. They created a high-quality dataset where every example was paired with the exact same instruction: 'Write a one-paragraph summary of the following article.' The model performs exceptionally well on this specific prompt. However, when beta testers use slightly different phrasing like 'Summarize this for me' or 'What are the main points of this text?', the model's performance drops significantly, often generating irrelevant or poorly structured responses. Based on this scenario, identify the most likely cause of this performance gap and propose a specific change to the fine-tuning dataset to resolve it.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A team is fine-tuning a language model for a single, specific task: extracting the main sentiment (positive, negative, or neutral) from customer reviews. To ensure the final model is robust and can handle the varied ways users might phrase this request, which of the following training data strategies is the most effective?
Diagnosing a Fine-Tuning Data Issue
Generating Diverse Instructions for a Summarization Task
Example of a Sentence-First Prompt for Grammaticality Judgment with Answer Options
Example of a Constraint-First Prompt for Grammaticality Judgment