When variables change together, they must have some element in common that underlies their relationship

Idea Underneath the Factor Analysis

In the context of factor analysis, the resulting clusters of highly correlated variables are interpreted as representing multiple measures of a single underlying construct. These foundational constructs that emerge from grouping the correlated variables are known as factors.

Factors in Factor Analysis

What is the primary function of the statistical technique known as factor analysis?

A researcher administers a 25-item survey measuring various aspects of stress and uses a statistical grouping technique to organize the items into clusters based on their intercorrelations. Two items—'I feel overwhelmed at work' and 'I have trouble sleeping'—are placed into different clusters. This placement indicates that these two items are strongly correlated with each other.

Factor analysis is a complex statistical technique used by researchers to investigate relationships among a large number of conceptually similar variables. The method functions by organizing these numerous variables into a smaller number of distinct clusters, grouping them so that variables within the same cluster are strongly correlated with each other, while variables across different clusters exhibit weak correlations.

Google

University of Michigan - Ann Arbor

Correlational research is a widespread type of non-experimental research in which an investigator measures two variables—either continuous or categorical—and evaluates the statistical relationship (correlation) between them. Crucially, the researcher does this with little to no effort to control extraneous variables or manipulate an independent variable. It is often chosen when a relationship is not believed to be causal, or when exploring causal relationships where manipulating the independent variable is impossible, impractical, or unethical. By utilizing this strategy, researchers can achieve two fundamental scientific goals: describing the strength and direction of the relationship between the variables, and predicting scores on one variable based on the other using a statistical technique called regression.

Correlational Research

Complex correlational research involves measuring multiple variables—which can be either binary or continuous—and assessing the statistical relationships among them. This approach extends beyond simple bivariate studies, allowing researchers to evaluate how an entire set of variables interconnects within a single study.

Complex Correlational Research

Trull , T. J., &amp; Prinstein , M. J. (2013). Research Methods in Clinical Psychology . In Clinical Psychology (Eighth, pp. 93–124). Textbook, Wadsworth Cengage Learning . 

Clinical Psychology Eighth Edition 

https://kpu.pressbooks.pub/psychmethods4e/

KPU Research Methods in Psychology - 4th American Edition

Various research methods are correlational in nature, meaning they allow researchers to identify important relationships between two or more variables of interest. These techniques include observational methods, case studies, survey research, and archival research. However, none of these correlational approaches can be used to make definitive claims about cause-and-effect relationships.

Correlational Research Techniques

Correlational research is effective at identifying relationships between variables but cannot establish causation. In contrast, experimental research is the only method that allows for cause-and-effect claims. This is because experiments are designed to control for or eliminate alternative explanations, enabling researchers to isolate how changes in one variable directly cause changes in another.

Comparison of Correlational and Experimental Research in Establishing Causation

A numerical index, commonly represented as Pearson's $$r$$, that measures the direction and strength of a linear relationship between two quantitative variables. The coefficient is bounded between $$-1.00$$ and $$+1.00$$, where values further from zero indicate a tighter, more predictable association, and values near zero indicate a negligible relationship. In research, this coefficient frequently serves as an effect size measure to evaluate how strongly variables are connected in the population.

Correlation Coefficient

The primary limitation of correlational research is its inability to establish a definitive cause-and-effect relationship. Even when a strong statistical association is found between variables, it does not prove that one causes the other. This principle holds true regardless of the strength of the correlation, meaning a very high correlation coefficient is not evidence of causation. This research method can only identify associations, not the underlying causal mechanisms.

The Fundamental Limitation of Correlational Research: Inability to Establish Causation

An illusory correlation, also known as a false correlation, is a common error in misinterpreting data where an individual believes a relationship exists between two things when no such relationship actually exists. This mistake frequently arises from unsystematic observations, leading people to erroneously claim a statistical association is present.

Illusory Correlation: Perceiving Nonexistent Relationships

A researcher conducts a study and finds that cities with a higher number of parks per capita also have a lower rate of reported respiratory illnesses. The researcher concludes that the presence of parks causes a decrease in respiratory illness. What is the primary flaw in this conclusion based on the research method described?

A researcher conducts a large-scale survey and finds a strong positive relationship between the amount of time people spend watching news coverage of disasters and their reported levels of anxiety. Based *only* on this finding, which of the following is the most valid conclusion?

A classic example of correlational research involves a researcher investigating the relationship between students' self-esteem and their school achievement, such as GPAs. By collecting data on these two naturally occurring variables to see if they are statistically related—without manipulating any independent variable—the researcher is conducting a correlational study.

Example of Correlational Research: Self-Esteem and School Achievement

Correlational research is frequently utilized to assess the reliability and validity of psychological measurements. For example, to evaluate the validity of a new, brief extraversion test, a researcher might administer it to a large group alongside a longer, established extraversion test. By checking if the scores on the brief test strongly correlate with the scores on the longer test, the researcher can determine the new test's validity. In these methodological evaluations, neither variable is assumed to cause the other, so the terms independent and dependent variable do not apply.

Using Correlation to Establish Measurement Reliability and Validity

An example of a correlational study necessitated by ethical constraints involves investigating the relationship between cannabis use and memory abilities. Because researchers cannot ethically manipulate the independent variable by forcing participants to use cannabis, they must rely on the correlational strategy. This involves measuring the natural frequency of participants' cannabis use alongside their memory performance on a standardized test to evaluate if the two variables are statistically related.

Example of Correlational Research: Cannabis Use and Memory

A common misconception among students is that correlational research must involve two quantitative variables. However, the defining feature of a correlational study is how it is conducted: both variables are merely measured, and neither is manipulated. This holds true whether the variables are quantitative (e.g., test scores) or categorical (e.g., nationality or occupation). For example, comparing the Rosenberg Self-Esteem Scale scores of American and Japanese college students is a correlational study because the researcher measured, rather than manipulated, the participants' nationalities.

Misconception About Variables in Correlational Research

Correlations have predictive value. Once a statistical relationship between two variables is observed and its strength is determined, this information can be used to predict one variable based on the other. For instance, observing strong correlations in existing data helps in predicting relative success or forecasting future outcomes in similar scenarios.

Predictive Value of Correlation

In correlational research, the specific methods and environments used to measure variables do not alter the study's methodological classification. It does not matter whether data is collected in a highly controlled laboratory using computerized tasks or in a naturalistic field setting using self-report surveys; as long as the researcher simply measures the variables as they naturally occur without manipulating an independent variable, the study remains correlational.

Data Collection in Correlational Research

In correlational research, when continuous measures produce highly skewed distributions—meaning the data is heavily clustered at one end of the scale—researchers may choose to transform them into dichotomous (binary) variables. For instance, a frequency measure of a rare behavior might be converted into a simple $$0$$ (did not occur) and $$1$$ (did occur) format to facilitate more accurate statistical analysis.

Dichotomizing Skewed Variables

Factor Analysis

In correlational research, line graphs are commonly used to depict statistical relationships when the variable plotted on the $$x$$-axis has, or is organized into, a small number of distinct values. For example, a line graph can effectively display how the mean of a continuous variable changes across four quartiles of another variable.

Line Graphs in Correlational Research

Scatterplots are a graphical method used to display correlations and relationships between quantitative variables. They are particularly useful when the variable plotted on the $$x$$-axis—typically the independent variable—has a large number of distinct levels. In a scatterplot, scores are plotted at the intersection of the values on the $$x$$-axis and $$y$$-axis, with each individual data point representing a single participant's scores across the two variables. Unlike line graphs, the points in a scatterplot stand alone and are not connected by lines.

Scatterplots

Correlational research is useful because it enables researchers to determine the strength and direction of relationships that naturally exist between two variables.

Usefulness of Correlational Research

While correlational research is valuable for identifying relationships among variables, it cannot establish causality. To make definitive statements about cause and effect, researchers must conduct a scientific experiment. Experiments incorporate methods that eliminate or control for alternative explanations, allowing researchers to determine if changes in one manipulated variable directly cause changes in another measured variable.

Establishing Causality via Experiments

A confounding variable is an extraneous variable that differs on average across levels of the independent variable, meaning it varies systematically alongside it. Because this variable differs systematically across conditions just like the independent variable, it provides a plausible alternative explanation for any observed difference in the dependent variable, making it difficult to establish a clear cause-and-effect relationship. For instance, if an extraneous variable like intelligence is substantially lower in one group than another, it becomes a confounder that confuses the results.

Confounding Variable

A major strength of correlational research is that it generally possesses higher external validity than experimental research. Due to the trade-off between internal and external validity, experiments often introduce artificial conditions to maximize internal validity (control). In contrast, correlational studies typically have low internal validity because nothing is manipulated or controlled by the experimenter. However, because variables are measured exactly as they naturally occur, the resulting statistical relationships are more likely to reflect real-world phenomena, granting them high external validity.

External Validity of Correlational Research

Because of the trade-off between internal and external validity, correlational research is highly valuable for providing converging evidence for a scientific theory. When a theory is supported by both a true experiment (which offers high internal validity to confirm causality) and a correlational study (which offers high external validity to confirm real-world relevance), researchers can have much greater confidence in the theory. For instance, correlational studies linking violent television to aggressive behavior are strongly complemented by experimental studies that confirm the relationship is causal.

Correlational Research as Converging Evidence

An illustrative example of a non-experimental, correlational study is John Cacioppo and Richard Petty's 1982 research. They validated their Need for Cognition Scale by comparing the scale scores of university professors with those of factory workers. This is not an experiment because the researchers simply measured pre-existing occupational groups rather than manipulating conditions or assigning participants.

Example of Correlational Research: Need for Cognition and Occupation

What defines a study as experimental or correlational is strictly how it is conducted, not the variables studied or the graphs used. For instance, in a study on daily to-do lists and stress, the design is an experiment if the researcher randomly assigned participants to make lists (manipulation), allowing for the conclusion that making lists reduces stress. However, if the researcher merely asked pre-existing groups if they make to-do lists, it is a correlational study. In the correlational case, one can only conclude the variables are statistically related, as stress might prevent planning (directionality problem) or conscientiousness might affect both (third-variable problem).

Example of Distinguishing Correlational and Experimental Research

The directionality problem is a fundamental reason why correlation does not imply causation. It occurs when two variables, $$X$$ and $$Y$$, are statistically related, but it is impossible to determine the causal direction of the effect. Because neither variable is manipulated by the researcher, one cannot confidently identify whether $$X$$ causes $$Y$$, or if $$Y$$ causes $$X$$. For example, a statistical relationship showing that people who exercise are happier could mean that exercising causes happiness, or conversely, that happiness gives people the energy and desire to exercise.

Directionality Problem

The third-variable problem is a primary reason why correlational research cannot establish causality. It occurs when a statistical relationship between two variables, $$X$$ and $$Y$$, is not due to a direct causal link between them, but rather because some unmeasured third variable, $$Z$$, independently causes both. This creates a spurious correlation. For instance, a statistical relationship between exercise and happiness might exist simply because a third variable, such as overall physical health, simultaneously causes people to exercise more and feel happier.

Third-Variable Problem

Which of the following best describes the primary approach of correlational research?

In a complex correlational study, Radcliffe and Klein investigated how middle-aged adults' optimism levels related to several other variables concerning heart attacks. By simultaneously measuring optimism, health behaviors, knowledge of risk factors, and personal risk beliefs, they assessed the statistical relationships among all these variables to show how optimism correlates with positive health profiles.

Example of Complex Correlational Research: Optimism and Health

While correlational research cannot unambiguously establish that one variable causes another, complex correlational research can be used to explore possible causal relationships by ruling out other plausible interpretations. This exploration is primarily achieved through the statistical control of potential third variables.

Exploring Causal Relationships in Correlational Research

Even complex correlational research cannot unambiguously establish that one variable causes another. Because these approaches are purely correlational, the best they can achieve is to demonstrate patterns of statistical relationships that are consistent with some causal interpretations and inconsistent with others.

Causal Limitations of Complex Correlational Research

Statistical regression is a technique that allows researchers to predict the value of one variable given the value of another variable. While correlation coefficients describe the strength and direction of a relationship, regression utilizes that established relationship to make specific mathematical predictions.

Statistical Regression

Jouriles and colleagues conducted a complex correlational study assessing the relationships among adolescents' experiences of physical aggression, psychological aggression, and psychological distress. To handle highly skewed distributions in their aggression measures, they first transformed them into dichotomous (binary) variables ($$0$$ for did not occur, $$1$$ for did occur) before computing the correlations among the constructs. They ultimately found that experiencing physical aggression was moderately correlated with psychological aggression, which in turn was related to symptoms of psychological distress.

Example of Complex Correlational Research: Relationship Aggression

A correlation matrix is a specific type of table utilized to present the correlation coefficients—typically Pearson’s $$r$$—among several different variables. To avoid redundant information and improve overall readability, only the lower half of the matrix is filled with values, as the upper half would display identical mirror correlations. Furthermore, because any variable's correlation with itself is always a perfect $$+1.00$$, these values along the diagonal are conventionally replaced with dashes.

Learn Before

Related

Learn After