Tied-at-R@10 as Non-Rejection of Equivalence Under a Power Bound, Not a Positive Equivalence Claim
The paper's Conclusion explicitly cautions that the strict-parity prerequisite evidence is confined to two template families and to 21/18 unique held-out targets in the strictest LectureBank/MOOC target-concept-disjoint controls. Because that limited held-out budget caps the statistical power of paired comparisons, the adaptive-vs-hierarchical tie at on the three headline datasets must be read as a non-rejection of equivalence under that power bound, not as a positive equivalence claim between the two systems. In other words, the tied result rules out a detectable headline-cutoff gain at the available sample size but does not assert that the two policies are equivalent in general.
0
1
Tags
Science
Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls
Related
Tied-at-R@10 as Non-Rejection of Equivalence Under a Power Bound, Not a Positive Equivalence Claim
Small Held-Out Target Sets in Target-Disjoint Prerequisite Splits
Bounded Empirical Findings with Explicit Boundary Checks
Three Durable Signals of Strict-Parity Prerequisite Retrieval
Tied-at-R@10 as Non-Rejection of Equivalence Under a Power Bound, Not a Positive Equivalence Claim
Analysis-Section Scope Statement: Evidence Specific to Curated, Template-Based Prerequisite QA