Target-Disjoint Reported in Main Paper, Question-Disjoint in Supplement
The paper's reporting policy is to summarize the stricter target-concept-disjoint results in the main paper and to relegate the question-disjoint control to the supplement. Target-disjoint is treated as the headline trust evidence because no test target concept appears as a target in training, which is the stronger guard against template-based shortcut behavior. Question-disjoint serves as a weaker corroborating control rather than the headline number.
0
1
Tags
Science
Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls
Related
Template Leakage Counts in Canonical Prerequisite QA Splits
Residual Target Overlap on Question-Disjoint Prerequisite Splits (4 LB-Full, 16 MOOC-CS)
Target-Concept-Disjoint Control Preserves Graph, Encoder, and Retrieval Hyperparameters
Two Question Families Bound the External Validity of Curated Prerequisite QA
Related
Template Leakage Counts in Canonical Prerequisite QA Splits
Residual Target Overlap on Question-Disjoint Prerequisite Splits (4 LB-Full, 16 MOOC-CS)
Target-Concept-Disjoint Control Preserves Graph, Encoder, and Retrieval Hyperparameters
Two Question Families Bound the External Validity of Curated Prerequisite QA