Bonferroni Procedure

Fisher's Least Significant Difference (LSD) Test

Tukey's Honestly Significant Difference (HSD) Test

Why do researchers use modified t-test procedures, such as the Bonferroni procedure or Tukey's honestly significant difference (HSD) test, rather than standard t-tests when conducting post hoc comparisons?

If a researcher decides to use standard t-tests rather than modified t-test procedures for multiple post hoc comparisons, they will successfully keep their overall risk of mistakenly rejecting a true null hypothesis at an acceptable level.

A researcher has found a significant difference in an ANOVA comparing the effects of four different study schedules on exam performance. After finding this overall difference, they must decide how to conduct follow-up tests. Match each of the researcher's subsequent actions or observations with the correct statistical term or procedure.

Arrange the following stages to represent the logical progression of identifying and managing error inflation when conducting post hoc comparisons in a study.

Suppose you are designing the statistical analysis protocol for a new research study evaluating the effectiveness of four distinct therapeutic interventions ($A$, $B$, $C$, and $D$). After finding a significant overall effect in an initial ANOVA, you must construct a post hoc analysis plan that compares all six possible pairs of interventions while strictly maintaining the overall familywise alpha level at exactly $5$. Which of the following analytical designs represents the most appropriate construction of this plan to prevent Type I error inflation?

Match each term associated with modified $t$-test procedures used in post hoc comparisons with its correct description or identifying characteristic.

A researcher evaluates a study comparing five different antidepressant medications and discovers that the authors performed ten pairwise comparisons using standard $t$-tests. The researcher correctly judges the study's conclusions to be unreliable because, without using a modified procedure like Tukey's HSD or the Bonferroni procedure, the authors failed to control for the inflation of the _____ error rate across the entire set of comparisons.

A researcher is studying the effects of three different diets on weight loss in rats. After finding a significant overall effect, they plan to run three post hoc comparisons. True or False: If they use standard $t$-tests instead of a modified procedure like Tukey's HSD, they will successfully keep their overall risk of making a Type I error close to $5\\%$.

A research group analyzes their experiment comparing four therapy types and notices that the overall risk of making a Type I error was kept close to $5\\%$ across all post hoc comparisons. By examining their analysis, you can determine that they must have used a modified $t$-test procedure, such as the _____ procedure, rather than multiple standard $t$-tests.

A researcher needs to evaluate and manage the risk of Type I error inflation when analyzing multiple group differences in a newly completed study. Order the following steps to represent the correct methodological sequence for identifying, evaluating, and addressing this statistical risk.

In a concise analytical response, state the primary risk researchers face when conducting multiple post hoc comparisons and list three specific modified $t$-test procedures designed to address this issue.

Diagnose the statistical flaw in the research team's data analysis plan, and explain what their shared goal should be when selecting an alternative analysis procedure.

A student researcher is writing a data analysis plan for a study that will require multiple post hoc comparisons. In one to two sentences, propose an appropriate statistical procedure the student should specify in their plan instead of standard $t$-tests to protect their results.