Learn Before
LightRAG-Style Baseline in Strict-Parity Prerequisite Retrieval
Truncated Personalized PageRank Baseline for Prerequisite Retrieval
Method Part 2: Adaptive Depth Gating for Prerequisite Retrieval (Auditable Strict-Parity Graph-RAG Paper)
MOOC-CS: Language Alignment Is The Bottleneck (Results) in Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls
Method Part 1: MOOC-CS Prerequisite Benchmark (Auditable Strict-Parity Graph-RAG Paper)
MOOC-CS Headline R@10 Numbers: LightRAG/Truncated-PPR 25.6-25.9 vs Adaptive/Hierarchical Tied at 23.1
On MOOC-CS under the paper's default English MiniLM strict-parity configuration, the headline retrieval table shows two clusters in R@: LightRAG-style and truncated personalized PageRank baselines attain the best R@ in the range -, while Adaptive (heuristic) depth gating and the fixed-depth hierarchical baseline are tied at . The paper labels this as its second corrective point: under an English-only encoder, graph traversal-policy choices do not separate adaptive depth from the hierarchical baseline, and the better-performing systems are the LightRAG-style and PPR-style baselines rather than the paper's hierarchical traversal — which motivates the subsequent language-matched controls reported in the MOOC-CS cleaning-controls table.
0
1
Tags
Science
Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls
Related
MOOC-CS Headline R@10 Numbers: LightRAG/Truncated-PPR 25.6-25.9 vs Adaptive/Hierarchical Tied at 23.1
MOOC-CS Headline R@10 Numbers: LightRAG/Truncated-PPR 25.6-25.9 vs Adaptive/Hierarchical Tied at 23.1
LectureBank-Full ΔR@k Peaks at k=4 (+6.4 Points, CI [1.0, 11.7])
Bidirectional Diffusion Hyperparameter Settings (LectureBank-Full Main Runs)
MOOC-CS ΔR@k Curve Stays Near Zero Across k (Adaptive vs Hierarchical)
Token-Cap Comparison on LectureBank-Full: Adaptive Loses More as Cap Tightens
MOOC-CS Headline R@10 Numbers: LightRAG/Truncated-PPR 25.6-25.9 vs Adaptive/Hierarchical Tied at 23.1
LectureBank-Full Tight-Budget Advantage of Adaptive Depth Gating (Mean ΔR@k = +2.13 over k∈{1,2,3,4})
MOOC-CS Headline R@10 Numbers: LightRAG/Truncated-PPR 25.6-25.9 vs Adaptive/Hierarchical Tied at 23.1
MOOC-CS Graph Gain Requires Language-Matched Controls
MOOC-CS Configuration Used in Hierarchical Prerequisite RAG (225 Concepts, 516 Edges, 1,016 QA)
MOOC-CS Headline R@10 Numbers: LightRAG/Truncated-PPR 25.6-25.9 vs Adaptive/Hierarchical Tied at 23.1
MOOC-CS Target-Disjoint R@10 Result (n=114): Negative Case, Adaptive Tied
Template Stripping on MOOC-CS Raises Hierarchical R@10 from 23.1 to 26.5 (MiniLM Encoder)