A counterfactual test changes one relevant or irrelevant feature and observes whether routing changes appropriately. It can reveal brittle shortcuts and unfair proxy use.

Counterfactual Tests Probe Decision Sensitivity

Groups may be routed to different tools, escalation delays, evidence quality, or error recovery even when final average accuracy looks similar. Evaluate path exposure and burden by group and need.

Fairness Can Fail Through Different Graph Paths

In this situation—changing a learner's name while holding the tutoring need constant—which choice best applies “Counterfactual Tests Probe Decision Sensitivity”?

Learn Before

Related