In statistical regression, the predictor variable is the variable that is used to make a prediction about another variable. It serves as the known input value from which the predicted outcome is derived.

Predictor Variable

Multiple regression is a statistical technique that extends simple regression by measuring several predictor variables ($$X_1, X_2, X_3, \dots, X_i$$) and using them to predict a single outcome variable ($$Y$$). It can also be utilized to describe the complex relationship between the outcome variable and a set of predictors. The result of this analysis is an equation that expresses the outcome variable as an additive combination of all the measured predictor variables.

Multiple Regression

In psychological research, what is the primary function of statistical regression?

While a correlation coefficient describes the strength and direction of a relationship, researchers use statistical ____ to make specific mathematical predictions about the value of one variable given another.

Statistical regression is a technique that allows researchers to predict the value of one variable given the value of another variable. While correlation coefficients describe the strength and direction of a relationship, regression utilizes that established relationship to make specific mathematical predictions.

Google

A numerical index, commonly represented as Pearson's $$r$$, that measures the direction and strength of a linear relationship between two quantitative variables. The coefficient is bounded between $$-1.00$$ and $$+1.00$$, where values further from zero indicate a tighter, more predictable association, and values near zero indicate a negligible relationship. In research, this coefficient frequently serves as an effect size measure to evaluate how strongly variables are connected in the population.

Correlation Coefficient

Complex correlational research involves measuring multiple variables—which can be either binary or continuous—and assessing the statistical relationships among them. This approach extends beyond simple bivariate studies, allowing researchers to evaluate how an entire set of variables interconnects within a single study.

Complex Correlational Research

https://kpu.pressbooks.pub/psychmethods4e/

KPU Research Methods in Psychology - 4th American Edition

The sign of a correlation coefficient, whether positive or negative, indicates the direction of the relationship between variables. Based on this directionality, correlations can be classified into three main types: positive, negative, and zero (no correlation).

Types of Correlation

A researcher is examining the statistical association between several pairs of variables. Which of the following numerical values represents the strongest association between two variables?

A correlation matrix is a specific type of table utilized to present the correlation coefficients—typically Pearson’s $$r$$—among several different variables. To avoid redundant information and improve overall readability, only the lower half of the matrix is filled with values, as the upper half would display identical mirror correlations. Furthermore, because any variable's correlation with itself is always a perfect $$+1.00$$, these values along the diagonal are conventionally replaced with dashes.

Correlation Matrix

The computational formula for Pearson's $$r$$ defines it as the mean cross-product of $$z$$ scores. To calculate it, each score for both variables is first transformed into a $$z$$ score. Then, each individual's two $$z$$ scores are multiplied to create a cross-product. The mean of all these cross-products represents Pearson's $$r$$, expressed by the formula: $$r = \frac {\sum(z_xz_y)}{N}$$.

Pearson's r Formula

Restriction of range is a statistical issue that occurs when one or both variables in a correlational study have a limited range of values in the sample relative to the actual population. This artificial limitation can cause a strong overall correlation to appear misleadingly weak or even non-existent. To prevent this, researchers should aim to collect data from subjects spanning a wide range of values for their primary variables.

Restriction of Range

The correlation coefficient indicates the strength of a statistical relationship between two variables. The relationship is considered the weakest when the correlation coefficient is closest to $${}0$$. A coefficient near $${}0$$ signifies a very weak, unpredictable relationship, regardless of whether the sign is positive or negative.

Identifying the Weakest Correlation

Statistical Regression

The test of the correlation coefficient is the appropriate null hypothesis test for evaluating statistical relationships between quantitative variables when Pearson's $$r$$ is used to describe the strength of those relationships. While it is possible to use the sample correlation coefficient to compute a $$t$$ score and proceed with a standard $$t$$-test, the correlation coefficient is mathematically structured so that it can also be treated directly as its own test statistic to find the $$p$$-value.

Test of the Correlation Coefficient

Scatterplots are highly effective for visually illustrating the varying strengths and directions of Pearson's $$r$$. A perfect negative relationship ($$r = -1.00$$) is depicted as a tight, downward-sloping straight line, whereas a moderate negative relationship ($$r = -0.50$$) shows points loosely clustered around a downward trend. A value of $$r = 0$$ appears as a shapeless cloud of points, indicating no relationship. Conversely, a moderate positive relationship ($$r = +0.50$$) shows a loose upward trend, and a perfect positive relationship ($$r = +1.00$$) features points falling exactly on an upward-sloping diagonal line.

Example of Scatterplots for Pearson's r Values

In psychological research, Cohen provided standard guidelines for interpreting the strength of a statistical relationship measured by Pearson's $$r$$. According to his criteria, $$r$$ values near $$\pm 0.10$$ are considered small, values near $$\pm 0.30$$ are considered medium, and values near $$\pm 0.50$$ are considered large. The positive or negative sign of the coefficient only signifies the direction of the relationship, so an $$r$$ value of $$-0.30$$ is just as strong as a value of $$+0.30$$.

Cohen's Guidelines for Interpreting Pearson's r

Which of the following best describes the function of a correlation coefficient in psychological research?

In a complex correlational study, Radcliffe and Klein investigated how middle-aged adults' optimism levels related to several other variables concerning heart attacks. By simultaneously measuring optimism, health behaviors, knowledge of risk factors, and personal risk beliefs, they assessed the statistical relationships among all these variables to show how optimism correlates with positive health profiles.

Example of Complex Correlational Research: Optimism and Health

Factor analysis is a complex statistical technique used by researchers to investigate relationships among a large number of conceptually similar variables. The method functions by organizing these numerous variables into a smaller number of distinct clusters, grouping them so that variables within the same cluster are strongly correlated with each other, while variables across different clusters exhibit weak correlations.

Factor Analysis

While correlational research cannot unambiguously establish that one variable causes another, complex correlational research can be used to explore possible causal relationships by ruling out other plausible interpretations. This exploration is primarily achieved through the statistical control of potential third variables.

Exploring Causal Relationships in Correlational Research

Even complex correlational research cannot unambiguously establish that one variable causes another. Because these approaches are purely correlational, the best they can achieve is to demonstrate patterns of statistical relationships that are consistent with some causal interpretations and inconsistent with others.

Causal Limitations of Complex Correlational Research

Jouriles and colleagues conducted a complex correlational study assessing the relationships among adolescents' experiences of physical aggression, psychological aggression, and psychological distress. To handle highly skewed distributions in their aggression measures, they first transformed them into dichotomous (binary) variables ($$0$$ for did not occur, $$1$$ for did occur) before computing the correlations among the constructs. They ultimately found that experiencing physical aggression was moderately correlated with psychological aggression, which in turn was related to symptoms of psychological distress.

Learn Before

Related

Learn After