LectureBank-Full Diffusion Gain over Static Parent Expansion (~18 R@10 Points)
On LectureBank-Full, the paper's deterministic bidirectional diffusion with role-aware quotas lifts Recall@ by roughly points relative to a static parent-expansion baseline (which expands each query along fixed prerequisite-parent links without diffusion). The same comparison shows that the contrast-based gating term of the adaptive controller adds only about one R@ point on top of the diffusion-and-quota baseline (paired-bootstrap delta pp, 95% CI , ). The Analysis section uses this contrast to conclude that the main retrieval gain comes from diffusion and quotas, not from depth gating.
0
1
Tags
Science
Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls
Related
LectureBank-Full R@10 Gain from Diffusion and Role-Aware Quotas
LectureBank-Full Configuration Used in Hierarchical Prerequisite RAG (208 Concepts, 899 Edges, 1,421 QA)
LectureBank-Full Target-Disjoint R@10 Result (n=164): Diffusion Gain Survives, Adaptive Tied
LectureBank-Full Generation Diagnostic: Token-F1 1.9 → 18.3, EM Stays 0.0
LectureBank-Full Error Taxonomy: Residual Misses Are Near-Misses Along the Local Prerequisite Graph
LectureBank-Full Paired Delta: Adaptive vs Hierarchical Baseline = +0.7 [-2.1, +3.6]
Token-Cap Comparison on LectureBank-Full: Adaptive Loses More as Cap Tightens
LectureBank-Full Tight-Budget Advantage of Adaptive Depth Gating (Mean ΔR@k = +2.13 over k∈{1,2,3,4})
LectureBank-Full ΔR@k Peaks at k=4 (+6.4 Points, CI [1.0, 11.7])
LectureBank-Full Diffusion Gain over Static Parent Expansion (~18 R@10 Points)
Bounded Held-Out Targets After Strictest Leakage Control (21 LectureBank-Full, 18 MOOC-CS)
LectureBank-Full Decomposition: Diffusion+Quotas Drive ~18 R@10 Points; Contrast Gating Adds At Most ~1 Point (Statistically Tied)
Bidirectional Diffusion Hyperparameter Settings (LectureBank-Full Main Runs)
Child/Bridge/Global Role Partition of Diffusion Candidates
Retrieval-Stage Role Quota (1, 4, 1) for Child/Bridge/Global
Deterministic Tie-Breaking Rule in Role-Aware Ranking
LectureBank-Full Diffusion Gain over Static Parent Expansion (~18 R@10 Points)