Learn Before
Diagnosing Performance Issues in Long-Document Summarization
Based on the described performance, identify the most likely challenge the model is facing when processing these long documents. Explain your reasoning and propose one specific, practical strategy the company could implement to improve the summary quality for the middle sections of the transcripts.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Ch.5 Inference - Foundations of Large Language Models
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Diagnosing Performance Issues in Long-Document Summarization
A research team uses a language model to perform question-answering on a 200-page technical manual. They observe that the model consistently provides accurate answers for questions related to content in the first 10 pages and the last 10 pages, but frequently hallucinates or provides incorrect answers for questions about content from pages 90-110. Which of the following challenges of processing long inputs best explains this specific pattern of failure?
Trade-offs in Long-Context Model Selection
Strategic Information Management in Context Scaling