Don't make such black and white interpretations

Factors Determining the p-value

Test Statistic

Misinterpretations of the p-value

Alpha (Level of Significance)

p-hacking

The 2015 Ban on Null Hypothesis Testing

Alpha Criterion

What does a p value represent in the context of psychological research?

If a psychology researcher calculates a p-value of 0.08, they will typically declare the experimental result to be statistically significant.

A social psychologist is analyzing data from four different studies. Based on the standard thresholds for statistical significance provided in the table, match each study's obtained p value with its correct interpretation.

A psychologist is comparing findings across four different research studies. Based on the definition of a p value and the significance thresholds provided in the table, arrange these findings in order from the outcome LEAST likely to have occurred by chance to the outcome MOST likely to have occurred by chance.

According to the standard threshold of significance ($p = 0.05$) in psychology, a research result is typically declared significant if the probability of it occurring purely by chance is less than $1$ in how many?

Misinterpretation of the p Value

Determinants of the $p$ Value

Based on the significance thresholds provided in the table and the definition of a $p$ value, match each statistical label with the correct description of its probability occurring purely by chance.

A researcher obtains a $p$ value of 0.02 and labels the result 'highly significant' ($**$). According to standard significance thresholds, where $* = p \leq 0.05$ and $** = p \leq 0.01$, this labeling is _____.

A cognitive psychologist conducts an experiment on learning styles and calculates a $p$ value of 0.04. Applying the standard threshold of significance ($p = 0.05$) described in the text, the researcher should declare this result to be statistically significant.

According to the standard threshold of significance ($p = 0.05$), a psychological research result is typically declared significant if the probability of the outcome occurring purely by chance is less than 1 in _____.

Evaluate the following three experimental results and arrange them in order from the outcome representing the lowest probability of occurring purely by chance (1) to the outcome representing the highest probability of occurring purely by chance (3).

Define what a $p$ value represents in the context of an experiment and state the standard threshold for declaring an experimental result to be statistically significant.

Based on the standard definition of a $p$ value and its typical threshold, explain in your own words what it means if the researchers determined the probability of their outcome occurring purely by chance was less than 1 in 20.

A psychology student runs an analysis on their study's data and discovers the probability of their results occurring purely by chance is 0.03. Applying the standard threshold of significance, what conclusion should the student draw about their experimental result, and why?

Reporting Effect Sizes in Null Hypothesis Significance Testing