Factorial designs use a specific numerical notation to describe their structure, where each number represents one independent variable and its value indicates the number of levels for that variable. By multiplying these numbers together, researchers can determine the total number of experimental conditions. For example, a $$3 	imes 2$$ factorial design indicates two independent variables—one with three levels and one with two levels—resulting in a total of six distinct conditions. While these designs can theoretically include any number of variables and levels, logistical constraints regarding the large number of conditions and required participants make designs with more than three independent variables uncommon in practice.

Factorial Design Notation

A main effect in a factorial design refers to the overall influence of a single independent variable on the dependent variable, determined by averaging the results across all levels of the other independent variables. Consequently, an experiment has exactly one potential main effect for each independent variable it includes.

Main Effect

A factorial design table visually represents the different combinations of independent variables in an experiment, where the columns typically represent the levels of one variable and the rows represent the levels of another. For example, in a $$2 	imes 2$$ factorial design investigating the effects of cell phone use and time of day on driving ability, the table creates four distinct cells representing the four possible experimental conditions: using a cell phone during the day, not using a cell phone during the day, using a cell phone at night, and not using a cell phone at night.

Example of a Factorial Design Table

A between-subjects factorial design is an experimental structure in which all of the independent variables are manipulated between subjects. This means that each participant is exposed to exactly one specific combination of the variables' levels, resulting in them being tested in one and only one experimental condition. For instance, in a $$2 	imes 2$$ study examining cell phone use and time of day, a participant would be assigned to drive either with a cell phone or without, and either during the day or at night, but never across multiple conditions.

Between-Subjects Factorial Design

A within-subjects factorial design is an experimental structure in which all of the independent variables are manipulated within subjects. In this approach, each participant is exposed to every possible combination of the independent variables' levels, requiring them to be tested across all conditions of the experiment. For example, in a $$2 	imes 2$$ study investigating cell phone use and time of day, a single participant would perform driving tests under all four distinct conditions: with and without a cell phone, both during the day and at night.

Within-Subjects Factorial Design

A mixed factorial design is an experimental structure that incorporates both between-subjects and within-subjects manipulations. Because factorial experiments involve multiple independent variables, researchers can opt to manipulate at least one variable between subjects (testing participants in only one of its levels) and another variable within subjects (testing the same participants across all of its levels). For example, a researcher might test all participants' driving ability both with and without a cell phone (a within-subjects factor) while assigning each participant to drive exclusively during the day or exclusively at night (a between-subjects factor).

Mixed Factorial Design

A non-experimental factorial design is a study structure that includes multiple independent variables, but unlike a true experiment, all of these variables are merely measured rather than actively manipulated. Because every factor in this design—such as pre-existing participant variables—is solely measured, the study is non-experimental and correlational in nature. Consequently, while researchers can examine the relationships between these non-manipulated variables, they cannot use this design to establish definitive cause-and-effect relationships.

Non-Experimental Factorial Design

In a factorial experiment with two independent variables, researchers often graph the results by plotting one independent variable along the $$x$$-axis and the second independent variable using differently colored bars or distinct line formats. The $$y$$-axis is always used to plot the dependent variable.

Graphing Factorial Experiments

The factorial ANOVA is a statistical test utilized when an experiment includes more than one independent variable, such as in a factorial design. While its foundational logic is identical to that of the one-way and repeated-measures ANOVAs, a factorial ANOVA is distinct because it computes a separate $$F$$ ratio and $$p$$-value for every main effect and for every interaction effect present in the study. The specific mathematical calculations must be modified depending on whether the study utilizes a between-subjects, within-subjects, or mixed design.

Factorial ANOVA

In a factorial design study by Schnall and colleagues, private body consciousness was utilized as a non-manipulated independent variable alongside a manipulated variable. The researchers actively manipulated disgust by placing participants in either a clean or messy room, but they simply measured participants' pre-existing levels of private body consciousness. This illustrates how experimental studies often combine manipulated factors with measured participant variables to examine their joint effects.

Example of a Non-Manipulated Independent Variable: Private Body Consciousness

In experimental research, an interaction effect (or simply an interaction) exists when the influence of one independent variable on a measured outcome is fundamentally altered depending on the specific level of a second independent variable. This indicates that the variables do not operate in isolation; rather, they combine to produce complex effects that cannot be fully explained by analyzing them independently.

Interaction Effect

An experiment by Schnall and colleagues on disgust and moral judgments serves as a key example of a factorial design because it includes more than one independent variable. To examine a complex psychological phenomenon, the researchers investigated the impact of two distinct independent variables—the manipulated physical cleanliness of a testing room (clean versus messy) and the measured participant variable of private body consciousness—on the dependent variable of how harshly participants judged moral transgressions. Because the study goes beyond a simple one-variable question and incorporates multiple independent variables, it typifies a factorial design.

Example of a Factorial Design

A $$2 \times 2 \times 2$$ factorial design contains three independent variables with two levels each, producing eight total conditions. For example, psychotherapy type, psychotherapy length, and therapist sex could each have two levels, creating all combinations of those factors.

Example of a $$2 \times 2 \times 2$$ Factorial Design

What is the defining characteristic of a factorial design?

A factorial design is the most common experimental approach for investigating multiple independent variables, which are also known as factors. In this structure, every level of one independent variable is systematically combined with every level of the other independent variables to create all possible combinations. Each unique combination of these levels forms a distinct condition within the experiment.

Google

In an ideal two-group experimental design, the only difference between the experimental and control groups is their exposure to the experimental manipulation. Both groups go through all phases of the study, but they experience different levels of the independent variable. The researcher then measures any changes produced in the dependent variable for each group and analyzes the collected data statistically to determine if there are meaningful differences between them.

Basic Two-Group Experimental Design

https://kpu.pressbooks.pub/psychmethods4e/

KPU Research Methods in Psychology - 4th American Edition

In an experimental design, the control group consists of participants who do not receive the experimental manipulation or treatment being tested. This group serves as a crucial baseline for comparison against the experimental group. To ensure a valid comparison, the control group must be treated as similarly as possible to the experimental group in all aspects except for the absence of the treatment. This careful handling allows researchers to isolate the specific effects of the manipulation.

Control Group

The group of participants/subjects in a research study designed to answer the research question by being exposed to the experimental manipulation of the independent variable.

Experimental Group

To test if technology use in the classroom affects learning, an experiment can be designed with two groups. The experimental group learns algebra using a computer program, which is the experimental manipulation. The control group learns the same subject from a teacher in a traditional classroom. Apart from the teaching method, both groups are treated similarly and their learning is measured in the same way to ensure a valid comparison.

Example of a Two-Group Experiment: Technology in the Classroom

The fundamental principle of a controlled experiment is to ensure that the only significant difference between the experimental and control groups is the experimental manipulation itself. By isolating this single variable, any subsequent, statistically meaningful differences observed in the dependent variable between the groups can be confidently attributed to the manipulation. This rigorous design allows researchers to infer a cause-and-effect relationship.

Logic of Causal Inference in Controlled Experiments

A researcher is conducting an experiment to determine if a new energy drink improves participants' performance on a complex puzzle. One group of participants drinks the new energy drink, while a second group drinks a similar-tasting beverage without the active ingredients. Both groups are then timed on how long it takes them to solve the same puzzle. For the researcher to validly conclude that the energy drink *caused* the observed difference in puzzle-solving times, which of the following is the most critical condition of the research design?

Learn Before

Related

Learn After