Learn Before
Scope Part 2: Strict-Parity Evaluation Contract for Graph-Aware (Auditable Strict-Parity Graph-RAG Paper)
Scope Part 2: Question-Disjoint and Target-Concept-Disjoint (Auditable Strict-Parity Graph-RAG Paper)
Method-Related Scope Notes for Claim-Level Traceability in Graph-RAG Evaluation (Auditable Strict-Parity Graph-RAG Paper)
Corrective Field Lesson: Four Required Ingredients for Honest Graph-RAG Claims
The abstract closes with a corrective and narrow field lesson: graph-specific gains in retrieval-augmented generation are easy to overstate when evaluations omit any of four ingredients — (i) matched-interface evaluation (same encoder, candidate pool, cutoff, matching rule, and split across systems), (ii) leakage audits (question-disjoint and target-concept-disjoint controls on canonical prerequisite splits), (iii) separate token-cap diagnostics (token caps reported alongside, not folded into, headline comparisons), and (iv) auditable artifacts (claim-to-artifact traceability so each empirical number can be reproduced). The lesson is framed as corrective rather than algorithmic: it does not propose a new retriever, but specifies the minimum reporting discipline under which graph-RAG superiority claims can be trusted.
0
1
Tags
Science
Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls
Related
Multilingual Encoder Plus CJK-Only Query Rewrite as a Non-Headline Control on MOOC-CS
Staged v6/v7 Snapshot Artifacts Are Not Headline Strict-Parity Adaptive Runs
Diffusion Retriever Framed as a Controlled Test Case Inside the Evaluation Framework
Corrective Field Lesson: Four Required Ingredients for Honest Graph-RAG Claims
Bounded Held-Out Targets After Strictest Leakage Control (21 LectureBank-Full, 18 MOOC-CS)
Corrective Field Lesson: Four Required Ingredients for Honest Graph-RAG Claims
Per-Table Traceability Mapping with LectureBank-Full Example
Reproducibility Artifact Bundle Contents for Hierarchical Prerequisite Graph RAG
Recentering the Paper on Auditable Evaluation Evidence (Dropping Earlier Semantic-Constraint Analyses)
Corrective Field Lesson: Four Required Ingredients for Honest Graph-RAG Claims