Learn Before
Define the 'file drawer problem' in scientific research and explain how it influences the proportion of Type I errors and the reported strength of relationships in published literature.
Question: Define the 'file drawer problem' in scientific research and explain how it influences the proportion of Type I errors and the reported strength of relationships in published literature.
Sample answer: The file drawer problem is a systemic publication bias where researchers and journal editors selectively publish studies that yield statistically significant results while ignoring or discarding studies with non-significant findings. Because these non-significant results are hidden away 'in a file drawer,' the published scientific literature becomes skewed, containing a disproportionately high rate of Type I errors (false positives). Consequently, the published research artificially overstates the true strength and prevalence of relationships between variables in the population.
Key points:
- Defines the file drawer problem as publication bias favoring statistically significant findings.
- Explains that non-significant findings are ignored, discarded, or hidden 'in a file drawer'.
- Identifies that both researchers and journal editors contribute to this selection process.
- Explains that this bias leads to a disproportionately high rate of Type I errors in the literature.
- Explains that it artificially overstates the true strength and prevalence of relationships in the population.
Rubric: To receive full credit, the response must: 1) Define the file drawer problem as a publication bias favoring statistically significant results while discarding/ignoring non-significant findings. 2) Mention that both researchers (by not submitting) and journal editors/reviewers (by not accepting) contribute to this bias. 3) Explain that the bias leads to an inflated rate of Type I errors (false positives) in published literature. 4) Explain that it causes published research to artificially overstate the true strength and prevalence of relationships in the population.
0
1
Tags
KPU
Research Methods in Psychology - 4th American Edition @ KPU
Related
Registered Reports
Journal of Articles in Support of the Null Hypothesis
Which of the following best describes the 'file drawer problem' in scientific research?
The file drawer problem implies that published scientific research may artificially overstate the true strength and prevalence of relationships between variables.
A research team is investigating whether a new study technique improves test scores. Match each specific scenario to its role or consequence within the file drawer problem.
Arrange the following steps in the correct order to illustrate how the file drawer problem leads to a biased understanding of a psychological phenomenon within the scientific literature.
Match each term related to publication bias to the definition that best describes its role in the scientific process.
Which of the following best describes the likely consequence for a researcher who relies solely on published literature in a field affected by the 'file drawer problem'?
When evaluating the credibility of a psychological claim based on published research, a scientist must account for the fact that the 'file drawer problem' causes the available evidence to _____ the true strength of the relationship between variables.
A research team conducts ten independent studies testing a new memory drug. Nine of these studies find no statistically significant difference and are left unpublished in the lab's records, while the single study that yields a statistically significant improvement is published in a journal. True or False: According to the concept of the file drawer problem, this selective publishing will lead the published scientific literature to artificially overstate the drug's true effectiveness in the population.
When researchers and journal editors selectively publish studies with statistically significant results while discarding those with non-significant findings, the resulting bias in the published literature leads to a disproportionately high rate of _____ errors.
Order the steps a researcher takes to evaluate whether a published psychological effect is overstated due to the file drawer problem.
Define the 'file drawer problem' in scientific research and explain how it influences the proportion of Type I errors and the reported strength of relationships in published literature.
Based on this scenario, identify and explain how Dr. Aris's decisions illustrate the file drawer problem. In your explanation, describe the specific consequences these decisions have on the validity of the published literature regarding this mindfulness application.
Imagine you are conducting a literature review to evaluate the effectiveness of a new cognitive behavioral therapy technique. Knowing that the psychological literature is affected by the file drawer problem, how should you apply this knowledge when interpreting the overall strength of the therapy's effects as reported in published journal articles?