LectureBank-Full Error Taxonomy: Residual Misses Are Near-Misses Along the Local Prerequisite Graph
Supplementary error-taxonomy counts for LectureBank-Full show that most residual retrieval misses under the paper's hierarchical and adaptive systems are near-misses along the local prerequisite graph — the retrieved concept is one or a few prerequisite-graph hops away from the gold target rather than being topically unrelated. Because residual errors cluster locally, the dataset offers little headroom for a depth-control fix and instead points toward seed quality and graph noise as the remaining bottlenecks.
0
1
Tags
Science
Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls
Related
LectureBank-Full R@10 Gain from Diffusion and Role-Aware Quotas
LectureBank-Full Configuration Used in Hierarchical Prerequisite RAG (208 Concepts, 899 Edges, 1,421 QA)
LectureBank-Full Target-Disjoint R@10 Result (n=164): Diffusion Gain Survives, Adaptive Tied
LectureBank-Full Generation Diagnostic: Token-F1 1.9 → 18.3, EM Stays 0.0
LectureBank-Full Error Taxonomy: Residual Misses Are Near-Misses Along the Local Prerequisite Graph
LectureBank-Full Paired Delta: Adaptive vs Hierarchical Baseline = +0.7 [-2.1, +3.6]
Token-Cap Comparison on LectureBank-Full: Adaptive Loses More as Cap Tightens
LectureBank-Full Tight-Budget Advantage of Adaptive Depth Gating (Mean ΔR@k = +2.13 over k∈{1,2,3,4})
LectureBank-Full ΔR@k Peaks at k=4 (+6.4 Points, CI [1.0, 11.7])
LectureBank-Full Diffusion Gain over Static Parent Expansion (~18 R@10 Points)
Bounded Held-Out Targets After Strictest Leakage Control (21 LectureBank-Full, 18 MOOC-CS)
LectureBank-Full Decomposition: Diffusion+Quotas Drive ~18 R@10 Points; Contrast Gating Adds At Most ~1 Point (Statistically Tied)
LectureBank-Full Error Taxonomy: Residual Misses Are Near-Misses Along the Local Prerequisite Graph
MOOC-CS Error Taxonomy: Residual Failures Dominated by Distant Misses and Bilingual Aliasing