Learn Before
QASC Directed Science-Fact Graph Reconstruction (Auditable Strict-Parity Graph-RAG Paper)
In the auditable strict-parity evaluation of prerequisite-graph retrieval for RAG, the QASC benchmark is rebuilt as a directed science-fact graph with 16,444 nodes and 25,590 edges. This provides a much larger and structurally different substrate than curated prerequisite DAGs. Because the official QASC test split withholds evidence, retrieval results are reported only on the 926-question validation split. Graph descriptors include a mean depth of 2.3, 79.7% of nodes with depth , a mean degree of 3.1, and a mean fact-text length of 8.9 tokens.
0
1
Tags
Science
Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls
Related
QASC Strict-Parity Result: ColBERTv2/RePlug Strongest (R@10 = 85.0 [83.4, 86.6])
QASC Generation Diagnostic: TF-IDF Multiple-Choice Scorer 76.8% (Hierarchical) vs 74.6% (Adaptive)
QASC Conclusion: Reranking Beats Hierarchical and Adaptive Graph Traversal
QASC Paired Delta: Adaptive vs Hierarchical Baseline = +0.5 [-0.5, +1.5]
QASC Directed Science-Fact Graph Reconstruction (Auditable Strict-Parity Graph-RAG Paper)