A written protocol is a comprehensive script or standardized set of guidelines that dictates everything experimenters must do and say during a study, from the initial greeting to the final dismissal. By ensuring that every researcher follows the exact same steps, a written protocol effectively minimizes unintended variation and prevents experimenter behavior from becoming a confounding variable.

Written Protocol

An automated procedure utilizes software or computer presentations to deliver instructions and collect data from participants without direct human interaction. By minimizing the experimenter's role in the testing process, automation serves as a powerful standardization tool that significantly reduces unintended variation and eliminates many opportunities for experimenter expectancy effects.

Automated Procedure

Anticipating participant questions is a strategy for standardizing experimental procedures. Researchers proactively try to predict what questions participants might have during the study and either answer them within the standardized instructions or develop pre-scripted standard answers to use if the questions are asked. This prevents unintended variation in how experimenters interact with different participants.

Anticipating Participant Questions

Training multiple experimenters together is a technique used to ensure consistency in research procedures. By having all experimenters practice the protocol with each other simultaneously, researchers can verify that everyone administers instructions, interacts with participants, and conducts the study in a uniform manner, thereby reducing the introduction of extraneous variables.

Training Multiple Experimenters

Experimenter cross-condition testing is a procedural safeguard where researchers ensure that each individual experimenter tests participants in all experimental conditions. This practice prevents a single experimenter's unique demeanor or interaction style from becoming a confounding variable by spreading their potential influence evenly across the entire study, rather than concentrating it in a single treatment or control group.

Experimenter Cross-Condition Testing

Standardizing interactions between researchers and participants is a crucial method for minimizing the influence of experimenter expectations. By ensuring that every participant experiences the exact same protocol—such as the researcher reading the same set of instructions word for word—researchers eliminate unintended variations in administration that could bias participant behavior.

Standardizing Interactions

A pilot test is a small-scale preliminary study conducted prior to a full experiment to ensure that a new research procedure functions exactly as planned. By running this trial, researchers can identify logistical issues, clarify instructions, and refine their methodology before committing resources to the main investigation.

Pilot Test

Standardizing the procedure is the process of minimizing unintended variation by conducting an experiment in the exact same way for all participants, regardless of their assigned condition. This consistency prevents extraneous variables, such as experimenter demeanor, from systematically affecting the results and creating confounds. Common standardization techniques include using written protocols, delivering standard or automated instructions, anticipating participant questions in advance, training multiple experimenters together, and ensuring each experimenter tests participants in all conditions.

Google

In experimental research, an extraneous variable is any factor that varies within the context of a study other than the specific independent and dependent variables being investigated. These variables pose a significant problem because many of them are likely to influence the dependent variable. If these outside factors fluctuate, they introduce competing influences that make it difficult to separate the true effect of the independent variable from the effects of the extraneous variables.

Extraneous Variable

Participant reactivity occurs when individuals alter their behavior or responses simply because they are aware they are being measured, which can significantly compromise the reliability and validity of the resulting data. While some disagreeable participants might intentionally disrupt the research, reactivity more frequently manifests as agreeable participants adjusting their answers to match what they perceive the researcher expects.

Participant Reactivity

https://kpu.pressbooks.pub/psychmethods4e/

KPU Research Methods in Psychology - 4th American Edition

A participant variable, also known as an individual difference, is a type of extraneous variable derived from the pre-existing characteristics of the individuals involved in an experiment. Examples of these variables include demographic factors such as gender, as well as personal attributes or habits like diet and writing ability. Because these individual differences are likely to have their own independent effect on the dependent variable, they must be controlled to prevent them from obscuring the effect of the experimental manipulation.

Participant Variable

A situational variable is a type of extraneous variable that involves the broader environmental or contextual conditions present during an experiment, such as the time of day, weather, or physical setting. Since these external factors can unintentionally influence participants' behavior and the dependent variable, researchers must rigorously control them to isolate the true effect of the independent variable.

Situational Variable

A task variable is a specific type of extraneous variable relating to the mechanics, materials, or procedures of the activity participants are asked to complete during a study. For example, whether a participant completes a task by hand or on a computer is a task variable. Because variations in how a task is administered can independently affect the dependent variable, they must be held constant.

Task Variable

Experimental control is the fundamental process by which researchers hold extraneous variables constant throughout a study. Because extraneous factors—such as individual participant differences or situational contexts—are likely to have an unintended effect on the dependent variable, they make it difficult to separate their impact from the true effect of the manipulated independent variable. By actively controlling these outside variables and preventing them from fluctuating across conditions, researchers can isolate the independent variable and confidently attribute any changes in the dependent variable to the experimental manipulation.

Experimental Control

The biological sex of a researcher can act as an extraneous variable by unintentionally influencing participant behavior. Because male and female experimenters often interact differently with subjects—and subjects respond differently to them—this variation can confound study results. For instance, in a pain perception study by Ibolya, Brake, and Voss (2004), participants immersed their hands in icy water longer when the experimenter was of the opposite sex, demonstrating that researcher characteristics must be controlled to prevent noise in the data.

Experimenter's Sex as an Extraneous Variable

Standardizing the Procedure

The experimenter expectancy effect occurs when a researcher's own expectations or beliefs about a study's outcome inadvertently bias the participants' behaviors in unintended ways. These subtle influences during the administration of a measure can systematically alter participant responses and compromise the study's validity.

Experimenter Expectancy Effect

In an experiment testing the effect of expressive writing on physical health, researchers must manage multiple extraneous variables. Participant variables (individual differences) like baseline writing ability, gender, and diet can independently affect health. Furthermore, situational and task variables, such as the weather, the time of day, and whether participants type or write by hand, can introduce unintended variability. Holding these factors constant is necessary to separate the actual impact of expressive writing from the influence of these outside variables.

Example of Extraneous Variables: Expressive Writing Experiment

A confounding variable is an extraneous variable that differs on average across levels of the independent variable, meaning it varies systematically alongside it. Because this variable differs systematically across conditions just like the independent variable, it provides a plausible alternative explanation for any observed difference in the dependent variable, making it difficult to establish a clear cause-and-effect relationship. For instance, if an extraneous variable like intelligence is substantially lower in one group than another, it becomes a confounder that confuses the results.

Confounding Variable

Internal validity indicates the degree to which an empirical study's design justifies the conclusion that changes in the independent variable directly caused the observed differences in the dependent variable. Experimental research designs typically achieve high internal validity because they involve deliberately manipulating an independent variable while rigorously controlling for extraneous variables, thereby eliminating alternative causal explanations. For instance, in the Darley and Latané experiment, the rigorous manipulation of the number of perceived bystanders isolated this independent variable as the direct cause of differences in helping behavior. In contrast, non-experimental correlational designs exhibit low internal validity; for example, a statistical relationship between regular exercise and happiness cannot confirm that exercise causes happiness, as other factors or reverse causation might explain the link.

Internal Validity

In the context of an experiment, what is an extraneous variable?

Socially desirable responding is a specific type of participant reactivity in which individuals provide answers they believe are socially acceptable rather than reflecting their true thoughts or feelings. For instance, a participant with low self-esteem might falsely agree that they feel like a person of worth, motivated by a desire to appear favorably in the eyes of the researcher rather than a genuine self-assessment.

Socially Desirable Responding

Demand characteristics are subtle cues inherent in a research study's design or procedure that unintentionally suggest to participants how the researcher expects them to behave. These cues can lead participants to deduce the study's purpose and systematically alter their responses. For example, if a participant's attitude toward exercise is measured immediately after reading an article about the risks of heart disease, they might reasonably infer the study's intent and report a more favorable attitude toward exercise to meet the perceived expectation.

Demand Characteristics

The Hawthorne effect is a specific form of reactivity where people modify their conduct solely because they are aware that a researcher is observing them. This shift in behavior can undermine the validity of observational research since the recorded actions do not reflect the individuals' true, unobserved state.

Hawthorne Effect

Designing measurement procedures to be as clear and brief as possible is a methodological strategy used to minimize participant reactivity. By keeping the study efficient and easy to understand, researchers prevent participants from experiencing fatigue or frustration, which could otherwise tempt them to intentionally disrupt the results or respond carelessly.

Clear and Brief Procedures

Guaranteeing anonymity is a crucial precaution to minimize participant reactivity, as it assures participants their responses cannot be traced back to them. Researchers can protect participant identities by ensuring individuals are seated far apart during group testing, providing uniform writing implements to eliminate identifiable marks, and using sealed individual envelopes or a mixed drop box for completed questionnaires.

Learn Before

Related

Learn After