1Cademy - QASC Paired Delta: Adaptive vs Hierarchical Baseline = +0.5 [-0.5, +1.5]

Learn Before

QASC Question Answering Benchmark
Method Part 2: Strict-Parity Evaluation Contract for Graph-Aware (Auditable Strict-Parity Graph-RAG Paper)
Method Part 1: Adaptive Depth Gating for Prerequisite Retrieval (Auditable Strict-Parity Graph-RAG Paper)
QASC Validation: Reranking Remains Stronger Than Either Hierarchical Or Adaptive Traversal (Results) in Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls

Example

QASC Paired Delta: Adaptive vs Hierarchical Baseline = +0.5 [-0.5, +1.5]

On the QASC validation split ( $n = 926$ ), the paired delta between Adaptive (heuristic) depth gating and the fixed-depth hierarchical baseline in R@ $10$ is only $+0.5$ points, with a 95% paired-bootstrap CI of $[-0.5, +1.5]$ . Because the CI straddles zero, the two systems are statistically tied under strict parity, which is why the paper presents adaptive depth gating as an optional extension rather than the core result on this dataset.