Small Held-Out Target Sets in Target-Disjoint Prerequisite Splits
Under the paper's strictest target-concept-disjoint control, the held-out test sets are small: only unique held-out targets on LectureBank-Full and on MOOC-CS, and these targets all come from the same two question families. As a consequence, even strict-parity headline numbers obtained under this control support only a narrow claim about curated, template-based prerequisite QA rather than broad graph-retrieval generalization.
0
1
Tags
Science
Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls
Related
Small Held-Out Target Sets in Target-Disjoint Prerequisite Splits
Bounded Empirical Findings with Explicit Boundary Checks
Three Durable Signals of Strict-Parity Prerequisite Retrieval
Tied-at-R@10 as Non-Rejection of Equivalence Under a Power Bound, Not a Positive Equivalence Claim
Analysis-Section Scope Statement: Evidence Specific to Curated, Template-Based Prerequisite QA