QASC Conclusion: Reranking Beats Hierarchical and Adaptive Graph Traversal
On the QASC science-fact graph, the paper's conclusion is that reranking remains stronger than either hierarchical or adaptive graph traversal under strict-parity comparison. The adaptive heuristic is statistically tied with the fixed-depth hierarchical baseline (), so the paper presents the adaptive controller as an optional extension rather than the core result on QASC. Reranking (ColBERTv2/RePlug, SP+) sits above both graph traversal policies in the strict-parity ordering on this benchmark.
0
1
Tags
Science
Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls
Related
QASC Directed Science Fact Graph Reconstruction (16,444 Nodes, 25,590 Edges)
QASC Strict-Parity Result: ColBERTv2/RePlug Strongest (R@10 = 85.0 [83.4, 86.6])
QASC Generation Diagnostic: TF-IDF Multiple-Choice Scorer 76.8% (Hierarchical) vs 74.6% (Adaptive)
QASC Conclusion: Reranking Beats Hierarchical and Adaptive Graph Traversal
QASC Paired Delta: Adaptive vs Hierarchical Baseline = +0.5 [-0.5, +1.5]
QASC Conclusion: Reranking Beats Hierarchical and Adaptive Graph Traversal
QASC Conclusion: Reranking Beats Hierarchical and Adaptive Graph Traversal