Two Question Families Bound the External Validity of Curated Prerequisite QA
The paper's two curated prerequisite-QA benchmarks instantiate only two question families, and the target-concept-disjoint splits expose only unique held-out targets on LectureBank-Full and on MOOC-CS. Because every test target is drawn from this narrow template space, the paper treats its evidence as specific to curated, template-based prerequisite QA rather than as evidence about broad educational or open-domain graph retrieval.
0
1
Tags
Science
Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls
Related
Two Question Families Bound the External Validity of Curated Prerequisite QA
Template Leakage Counts in Canonical Prerequisite QA Splits
Target-Disjoint Reported in Main Paper, Question-Disjoint in Supplement
Residual Target Overlap on Question-Disjoint Prerequisite Splits (4 LB-Full, 16 MOOC-CS)
Target-Concept-Disjoint Control Preserves Graph, Encoder, and Retrieval Hyperparameters
Two Question Families Bound the External Validity of Curated Prerequisite QA