Learn Before
A research team uses a language model to perform question-answering on a 200-page technical manual. They observe that the model consistently provides accurate answers for questions related to content in the first 10 pages and the last 10 pages, but frequently hallucinates or provides incorrect answers for questions about content from pages 90-110. Which of the following challenges of processing long inputs best explains this specific pattern of failure?
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Ch.5 Inference - Foundations of Large Language Models
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Diagnosing Performance Issues in Long-Document Summarization
A research team uses a language model to perform question-answering on a 200-page technical manual. They observe that the model consistently provides accurate answers for questions related to content in the first 10 pages and the last 10 pages, but frequently hallucinates or provides incorrect answers for questions about content from pages 90-110. Which of the following challenges of processing long inputs best explains this specific pattern of failure?
Trade-offs in Long-Context Model Selection
Strategic Information Management in Context Scaling