Types of Reliability

A team of researchers develops a new questionnaire designed to measure an individual's level of creativity. Which of the following outcomes would provide the strongest evidence that the new questionnaire is reliable?

A research team develops a new observational checklist to measure 'attentive behavior' in preschoolers. Two different researchers use the checklist to observe the same child at the same time, but their final scores for the child's attentiveness are completely different. When this process is repeated with other children, the two researchers' scores continue to show no relationship to each other. Based on this information, what is the most significant problem with this new checklist?

Replication of Studies in Psychology

Alfred Binet's Intelligence Test

Standardization

In psychological research, what does the reliability of a measurement tool refer to?

A researcher administers a newly developed intelligence test to a group of students and then re-administers it to the same group a week later under the same conditions. If the students' scores are significantly different between the two administrations, the test is demonstrating high reliability.

In psychological research, reliability manifests in several ways. Match each research scenario with the specific type of consistency (or lack thereof) it demonstrates.

A research team is evaluating the reliability of a new 'Social Anxiety Scale' to determine if it is stable enough for use in a long-term clinical study. Arrange the following findings in order, from the result that provides the least support for the tool's consistency to the result that provides the most robust evidence for its stability over time.

In the context of psychological research, what is the primary characteristic of a 'reliable' measurement tool, such as an intelligence assessment?

In psychological research, reliability involves maintaining consistency under different conditions. Match each term with the scenario or description that best illustrates it.

A researcher is evaluating a new intelligence assessment. A student takes the test on Monday and scores $120$. On Tuesday, under identical conditions and with no changes in the student's cognitive state, the student takes the test again and scores $80$. By analyzing the discrepancy between these two results for a stable trait, the researcher concludes that the assessment lacks _____.

A clinical psychologist administers a new spatial reasoning test to a group of participants on Monday, and then administers the exact same test to the same participants on Friday under identical conditions. If the participants receive almost identical scores on both administrations, this outcome demonstrates that the spatial reasoning test is reliable.

A research team evaluates a new diagnostic checklist. When Psychologist A uses the checklist to evaluate a patient, they diagnose them with mild depression, but when Psychologist B evaluates the same patient on the same day using the same checklist, they diagnose them with severe anxiety. Analyzing these discrepant outcomes suggests that the diagnostic checklist lacks _____.

A psychologist is evaluating the results of test-retest administrations for four experimental intelligence assessment tools. Evaluate the strength of the reliability evidence based on their Pearson correlation coefficients ($r$), and arrange the assessments in order from the one showing the STRONGEST evidence of reliability to the one showing the WEAKEST evidence of reliability.