Test-Retest Correlation

Assessing Test-Retest Reliability

Example of Reliability Without Validity

Test-retest reliability is considered an appropriate standard of consistency for which type of psychological construct?

A psychological measure designed to assess immediate stress levels must demonstrate high test-retest reliability to be considered a useful instrument.

A researcher is deciding whether test-retest reliability is an appropriate metric to evaluate the consistency of several different psychological measures. Match each construct with the correct rationale for using (or not using) this form of reliability.

A research team is reviewing the quality of several new psychological instruments. Rank the following scientific evaluations from the least appropriate application of test-retest reliability to the most appropriate application based on the nature of the constructs and the evidence provided.

Which procedure is used to assess the test-retest reliability of a psychological measure?

Match each research scenario with the correct interpretation of its test-retest reliability based on the nature of the construct being measured.

A researcher finds that a measure of 'General Intelligence' and a measure of 'Immediate Mood' both yield a test-retest correlation of $r = +0.20$. Upon analysis, the researcher concludes that the 'Immediate Mood' measure may be functioning correctly, but the 'General Intelligence' measure is severely flawed because intelligence is theoretically a(n) _____ construct.

A clinical psychologist develops a new survey to measure 'state anxiety' (an individual's immediate, fluctuating level of anxiety in response to temporary stressors). To demonstrate that this new survey is a reliable and high-quality measure, the psychologist must show that it has high test-retest reliability (such as a correlation of $r = +0.80$ or higher) over a two-week interval.

A researcher is analyzing why a newly developed psychological scale of 'trait self-esteem' yielded an unexpectedly low test-retest reliability correlation of $r = +0.35$ over a three-week interval. To systematically diagnose the root cause of this low correlation, arrange the analytical steps in the most logical order from first to last.

A research panel is evaluating a newly proposed scale designed to measure 'immediate state of mindfulness' (a transient, rapidly fluctuating mental state). The creators of the scale boast that it is highly reliable, citing a test-retest correlation of $r = +0.85$ over a two-week interval. To critically evaluate this claim, the panel must determine if this reliability metric is actually appropriate. Because an immediate state of mindfulness is theoretically expected to change frequently, a high test-retest correlation over two weeks indicates that the scale is likely measuring a stable trait rather than a transient state. Consequently, the panel should evaluate this specific reliability evidence as _______________ for proving the scale's sensitivity to transient mindfulness.