Case Study

Explain why the researcher is unable to reject the null hypothesis in this scenario. In your answer, demonstrate your comprehension of how redefining 'extreme' to one tail impacts the critical value and the consequences of a result falling in the unexpected direction.

Case context: A psychology researcher is planning an experiment to test if a new mindfulness technique decreases anxiety scores. The study has 2424 degrees of freedom, and the alpha level is set at .05.05. Before collecting data, the researcher pre-registers a directional hypothesis predicting a lower sample mean for the mindfulness group, establishing a one-tailed test with a critical value of 1.711-1.711. After data collection, they discover that the mindfulness group actually had higher anxiety scores than the control group, yielding a positive test statistic with a very large effect size.

Question: Explain why the researcher is unable to reject the null hypothesis in this scenario. In your answer, demonstrate your comprehension of how redefining 'extreme' to one tail impacts the critical value and the consequences of a result falling in the unexpected direction.

Sample answer: By choosing a one-tailed test, the researcher redefined 'extreme' to refer to only one tail of the distribution (the lower tail). This redefined boundary makes the critical value less severe (1.711-1.711) in the expected direction. However, the trade-off of this decision is that if the sample mean differs in the unexpected direction (higher anxiety scores), the null hypothesis cannot be rejected at all. Therefore, despite the large effect size, the positive test statistic falls in the unexpected tail, meaning the researcher has zero chance of rejecting the null hypothesis.

Key points:

  • Redefining 'extreme' to refer to only one tail of the distribution makes the critical value less severe.
  • A one-tailed test uses only a single critical value based on the pre-registered directional hypothesis.
  • If the result differs in the unexpected direction, the null hypothesis cannot be rejected at all.
  • A large effect size in the unexpected direction has no impact on the inability to reject the null hypothesis.

Rubric: The response should show comprehension that a one-tailed test redefines 'extreme' to one tail, which lowers the threshold (makes it less severe) for rejection in the expected direction. It must also explain that falling in the unexpected direction (positive test statistic when predicting lower scores) prevents the null hypothesis from being rejected, regardless of the effect size.

0

1

Updated 2026-05-27

Contributors are:

Who are from:

Tags

KPU

Research Methods in Psychology - 4th American Edition @ KPU

Related