Learn Before
Debugging Data Preprocessing for a Summarization Model
Based on the provided case study, analyze the likely cause of the model's poor performance. Explain how the data formatting could be improved using a special separator token and why this change would help the model better distinguish between the article and its intended summary.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
A language model is being prepared for a question-answering task. The model must process both the question and its corresponding answer as a single, combined sequence. If the question is 'What is the capital of France?' and the answer is 'Paris', how should these two sequences be formatted for the model using a special separator token to distinguish between them?
Diagnosing Model Training Issues from Data Formatting
Debugging Data Preprocessing for a Summarization Model
Example of Sequence Packing for Translation