Example

Template Leakage Counts in Canonical Prerequisite QA Splits

The canonical prerequisite QA splits used by this paper are heavily templated and share substantial surface forms across train and test. On LectureBank-Full the canonical split shares 9292 exact train–test questions and 8080 train–test target concepts. On MOOC-CS it shares 6868 exact questions and 6060 target concepts. These counts motivate reporting question-disjoint and target-concept-disjoint controls rather than relying on the canonical splits, because a system can otherwise match memorized surface forms.

0

1

Updated 2026-05-17

Contributors are:

Who are from:

Tags

Science

Auditable Strict-Parity Evaluation of Prerequisite-Graph Retrieval for RAG under Leakage Controls