Learn Before
Describe how each of the research team's three proposed methods demonstrates criterion validity according to the principles of psychological measurement. In your answer, explain what the experiment would simultaneously prove if the anxiety manipulation group scored distinctly higher on the scale than the practice group.
Case context: A team of researchers is developing a new self-report scale to measure 'academic test anxiety.' To evaluate the scale's criterion validity, they plan to administer it alongside an established test anxiety scale and a scale measuring general happiness (a conceptually distinct construct). Finally, they will conduct an experiment where one group is told they are taking a high-stakes graded exam (anxiety manipulation) and another group is told they are practicing ungraded questions, after which both groups will complete the new scale.
Question: Describe how each of the research team's three proposed methods demonstrates criterion validity according to the principles of psychological measurement. In your answer, explain what the experiment would simultaneously prove if the anxiety manipulation group scored distinctly higher on the scale than the practice group.
Sample answer: The first method demonstrates criterion validity by analyzing the correlations among multiple measures of the same construct (the new anxiety scale and the established anxiety scale). The second method verifies expected relationships with a measure of a conceptually distinct construct (general happiness). The third method uses an experimental manipulation. If the high-stakes exam group scores distinctly higher than the practice group on the new scale, it simultaneously demonstrates that the experimental manipulation worked to induce anxiety and that the measurement tool itself is valid.
Key points:
- Correlating the new scale with an established scale represents analyzing correlations among multiple measures of the same construct.
- Correlating the scale with a general happiness scale represents verifying expected relationships with conceptually distinct constructs.
- The experimental setup provides evidence of criterion validity through experimental manipulation.
- A distinct difference between groups simultaneously proves that the manipulation worked and that the measurement tool was valid.
Rubric: Responses should identify the first method as correlating multiple measures of the same construct, the second as verifying relationships with conceptually distinct constructs, and the third as using an experimental manipulation. The response must also explain that a distinct difference between groups simultaneously proves the manipulation worked and the measurement tool is valid.
0
1
Tags
KPU
Research Methods in Psychology - 4th American Edition @ KPU
Related
MacDonald and Martineau Mood Manipulation
In psychological research, how is criterion validity primarily evaluated?
A researcher develops a new self-report measure of stress. In an experiment, one group of participants is asked to perform a difficult mental arithmetic task under time pressure (stress-induction condition), while a control group sits quietly. If the stress-induction group scores significantly higher on the new measure than the control group, this experimental outcome serves as evidence that the new stress measure is valid.
A psychological researcher is attempting to establish the criterion validity of several new measures. Match each research scenario with the specific way it provides evidence for the measure's validity.
A researcher is evaluating the criterion validity of a new scale designed to measure 'Test Anxiety'. Rank the following research findings based on how directly they provide evidence for criterion validity, from the most direct evidence (behavioral or experimental) to the least relevant evidence.
You are tasked with constructing a validation strategy for a new 'Digital Distraction Scale' (DDS). To provide comprehensive evidence for criterion validity, which of the following research plans correctly synthesizes an experimental manipulation with a correlational check against a conceptually distinct but related construct?
A researcher is evaluating the criterion validity of a new assessment tool. Match each method of gathering evidence with the description of how it supports the validity of the measure.
A researcher claims their new 'Focus Scale' is valid because it shows high internal consistency. As a critical reviewer, you judge this claim as a category error, noting that internal consistency is a measure of reliability and that the researcher has failed to provide empirical evidence of _____ validity by demonstrating that the scale actually predicts performance on a concrete behavioral task, such as a sustained attention test.
The type of measurement validity that involves evaluating how effectively a measure aligns with expectations by correlating it with relevant variables or by verifying the results of an experimental manipulation is _____ validity.
A researcher uses an experimental mood manipulation—having participants recall either a joyful memory or a distressing memory—to gather criterion validity evidence for a new mood scale. The scale shows no statistically significant difference between the two groups. Based on this finding alone, it is valid to conclude definitively that the mood scale lacks criterion validity.
A researcher is preparing a grant proposal and must present evidence for the criterion validity of a new 'Perceived Stress Scale.' Rank the four findings below from strongest (1) to weakest (4) in terms of how directly each one supports criterion validity.
Define criterion validity and explain the three specific methods described in the text that researchers use to evaluate it.
Describe how each of the research team's three proposed methods demonstrates criterion validity according to the principles of psychological measurement. In your answer, explain what the experiment would simultaneously prove if the anxiety manipulation group scored distinctly higher on the scale than the practice group.
Imagine you are replicating the MacDonald and Martineau mood manipulation experiment. If you successfully manipulate participants' moods by instructing them to think positive versus negative thoughts, and your subsequent mood measurement tool reveals a distinct difference between the two groups, what dual conclusions can you draw from this outcome?