Residual Target Overlap on Question-Disjoint Prerequisite Splits (4 LB-Full, 16 MOOC-CS)
On the released question-disjoint splits, exact-string question-disjointness is only a partial leakage control: train--test target-concept overlap drops but does not disappear. target concepts remain shared on LectureBank-Full and remain shared on MOOC-CS. This residual overlap motivates the paper's stricter target-concept-disjoint control.
0
1
Tags
Science
Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls
Related
Template Leakage Counts in Canonical Prerequisite QA Splits
Target-Disjoint Reported in Main Paper, Question-Disjoint in Supplement
Residual Target Overlap on Question-Disjoint Prerequisite Splits (4 LB-Full, 16 MOOC-CS)
Target-Concept-Disjoint Control Preserves Graph, Encoder, and Retrieval Hyperparameters
Two Question Families Bound the External Validity of Curated Prerequisite QA
Target-Concept-Disjoint Control Preserves Graph, Encoder, and Retrieval Hyperparameters
Residual Target Overlap on Question-Disjoint Prerequisite Splits (4 LB-Full, 16 MOOC-CS)
LectureBank-Full Target-Disjoint R@10 Result (n=164): Diffusion Gain Survives, Adaptive Tied
MOOC-CS Target-Disjoint R@10 Result (n=114): Negative Case, Adaptive Tied
Adaptive Depth Gating Stays Tied to Hierarchical Baseline Under Target-Disjoint Control