A researcher administers a newly developed questionnaire measuring a stable personality trait to a group of participants on two separate occasions, a week apart. They then calculate the statistical coefficient between the two sets of scores to evaluate consistency over time. What is this coefficient called, and what value would generally indicate that the questionnaire has good reliability?

Test-retest correlation is the statistical coefficient calculated between two sets of scores from a measure administered at different times. A test-retest correlation of $$+.80$$ or greater is generally considered to indicate good reliability for constructs expected to be stable. For example, the Rosenberg Self-Esteem Scale demonstrated a highly reliable test-retest correlation of $$+.95$$ when administered to students twice, a week apart.

Google

Test-retest reliability evaluates the extent to which a psychological measure yields consistent scores when administered to the same individuals across different times. This form of reliability is crucial when assessing constructs that are theoretically expected to remain stable, such as intelligence or self-esteem. However, it is not an appropriate standard for constructs that naturally vary over time, like mood or immediate stress levels.

Test-Retest Reliability

Assessing test-retest reliability involves measuring the same group of participants at two separate times and calculating the correlation between their scores. This statistical relationship is commonly visualized using a scatterplot. Since standard research designs often only test participants once, researchers might specifically design a two-phase study for a new measure to evaluate this reliability. Alternatively, data from a study designed to answer a different research question can be utilized if the measure was administered multiple times. For instance, if an instructor measures students' attitudes at the start and end of a semester to detect learning changes, the correlation between those two sets of scores can simultaneously be used to assess the measure's test-retest reliability, even if no overall attitude change occurred.

Assessing Test-Retest Reliability

https://kpu.pressbooks.pub/psychmethods4e/

KPU Research Methods in Psychology - 4th American Edition

Test-Retest Correlation

A measurement tool can yield highly consistent results without actually measuring the intended construct. For instance, attempting to measure a person's self-esteem by using a ruler to measure their index finger length would demonstrate excellent test-retest reliability, as finger length is stable over time. However, this method would have absolutely no validity, as finger length has no conceptual relationship to self-esteem.

Example of Reliability Without Validity

Test-retest reliability is considered an appropriate standard of consistency for which type of psychological construct?

To assess test-retest reliability, a researcher administers the same measure to the same group of participants at two different times and then calculates the ____ between the two sets of scores.

Learn Before

Related

Learn After