Learn Before
Imagine you are conducting a literature review to evaluate the effectiveness of a new cognitive behavioral therapy technique. Knowing that the psychological literature is affected by the file drawer problem, how should you apply this knowledge when interpreting the overall strength of the therapy's effects as reported in published journal articles?
Question: Imagine you are conducting a literature review to evaluate the effectiveness of a new cognitive behavioral therapy technique. Knowing that the psychological literature is affected by the file drawer problem, how should you apply this knowledge when interpreting the overall strength of the therapy's effects as reported in published journal articles?
Sample answer: When interpreting the published literature, I should assume that the reported strength of the therapy's effectiveness is likely artificially overstated relative to its true effect in the population. To get a more accurate estimate, I should actively search for unpublished null findings, replication attempts, or registered reports.
Key points:
- Concludes that the therapy's effect size in published literature is likely overstated relative to the population.
- Recognizes that non-significant studies of the therapy are probably missing from the review.
- Proposes a method to locate unbiased data, such as searching for registered reports or null results.
Rubric: To receive full credit, the response must apply the concept of the file drawer problem by: 1) Stating that the reported effectiveness of the therapy in published articles should be interpreted as likely overstated or inflated compared to its actual population effect. 2) Suggesting a concrete step to counter this bias (such as looking for registered reports, replication studies, or sources documenting null/non-significant results).
0
1
Tags
KPU
Research Methods in Psychology - 4th American Edition @ KPU
Related
Registered Reports
Journal of Articles in Support of the Null Hypothesis
Which of the following best describes the 'file drawer problem' in scientific research?
The file drawer problem implies that published scientific research may artificially overstate the true strength and prevalence of relationships between variables.
A research team is investigating whether a new study technique improves test scores. Match each specific scenario to its role or consequence within the file drawer problem.
Arrange the following steps in the correct order to illustrate how the file drawer problem leads to a biased understanding of a psychological phenomenon within the scientific literature.
Match each term related to publication bias to the definition that best describes its role in the scientific process.
Which of the following best describes the likely consequence for a researcher who relies solely on published literature in a field affected by the 'file drawer problem'?
When evaluating the credibility of a psychological claim based on published research, a scientist must account for the fact that the 'file drawer problem' causes the available evidence to _____ the true strength of the relationship between variables.
A research team conducts ten independent studies testing a new memory drug. Nine of these studies find no statistically significant difference and are left unpublished in the lab's records, while the single study that yields a statistically significant improvement is published in a journal. True or False: According to the concept of the file drawer problem, this selective publishing will lead the published scientific literature to artificially overstate the drug's true effectiveness in the population.
When researchers and journal editors selectively publish studies with statistically significant results while discarding those with non-significant findings, the resulting bias in the published literature leads to a disproportionately high rate of _____ errors.
Order the steps a researcher takes to evaluate whether a published psychological effect is overstated due to the file drawer problem.
Define the 'file drawer problem' in scientific research and explain how it influences the proportion of Type I errors and the reported strength of relationships in published literature.
Based on this scenario, identify and explain how Dr. Aris's decisions illustrate the file drawer problem. In your explanation, describe the specific consequences these decisions have on the validity of the published literature regarding this mindfulness application.
Imagine you are conducting a literature review to evaluate the effectiveness of a new cognitive behavioral therapy technique. Knowing that the psychological literature is affected by the file drawer problem, how should you apply this knowledge when interpreting the overall strength of the therapy's effects as reported in published journal articles?