Learn Before
File Drawer Problem
The file drawer problem refers to a systemic publication bias where researchers and journal editors selectively publish studies that yield statistically significant results while ignoring or discarding studies with non-significant findings. Because these non-significant results are hidden away 'in a file drawer,' the published scientific literature becomes skewed, often containing a disproportionately high rate of Type I errors. Consequently, the published research may artificially overstate the true strength and prevalence of relationships between variables in the population.
0
1
Tags
KPU
Research Methods in Psychology - 4th American Edition @ KPU
Related
File Drawer Problem
p-hacking
Replication of Studies in Psychology
Example of Type I and Type II Errors
In null hypothesis testing, which of the following best defines a Type I error?
A researcher evaluates a new cognitive training program that, in reality, has no effect on memory. Due to an unusual sample, the statistical analysis produces a significant result, causing the researcher to incorrectly conclude that the program works. This situation describes a Type I error.
To understand a Type I error, one must distinguish between the true state of the population and the decision made by the researcher. Match each component of a Type I error to the description that best explains its role.
A Type I error is the result of a specific logical failure during the hypothesis-testing process. Arrange the following events in the correct order to illustrate the progression of a Type I error, starting from the actual state of the population to the researcher's final conclusion.
You are designing a computer simulation to help students visualize the logic of statistical decision-making in psychology. To successfully create a scenario where the software can generate a Type I error, which combination of population characteristics and decision rules must you program into the model?
In psychological research, a Type I error is also known as a 'false positive.'
A researcher must decide between two significance levels for a study on a new behavioral therapy. They evaluate the trade-offs and conclude that it is more damaging to give patients 'false hope' with a treatment that does not work than to miss a potentially helpful therapy. To align with this evaluation, the researcher selects a lower level to minimize the probability of a _____.
Learn After
Registered Reports
Journal of Articles in Support of the Null Hypothesis
Which of the following best describes the 'file drawer problem' in scientific research?
The file drawer problem implies that published scientific research may artificially overstate the true strength and prevalence of relationships between variables.
A research team is investigating whether a new study technique improves test scores. Match each specific scenario to its role or consequence within the file drawer problem.
Arrange the following steps in the correct order to illustrate how the file drawer problem leads to a biased understanding of a psychological phenomenon within the scientific literature.
Match each term related to publication bias to the definition that best describes its role in the scientific process.
Which of the following best describes the likely consequence for a researcher who relies solely on published literature in a field affected by the 'file drawer problem'?
When evaluating the credibility of a psychological claim based on published research, a scientist must account for the fact that the 'file drawer problem' causes the available evidence to _____ the true strength of the relationship between variables.
A research team conducts ten independent studies testing a new memory drug. Nine of these studies find no statistically significant difference and are left unpublished in the lab's records, while the single study that yields a statistically significant improvement is published in a journal. True or False: According to the concept of the file drawer problem, this selective publishing will lead the published scientific literature to artificially overstate the drug's true effectiveness in the population.
When researchers and journal editors selectively publish studies with statistically significant results while discarding those with non-significant findings, the resulting bias in the published literature leads to a disproportionately high rate of _____ errors.
Order the steps a researcher takes to evaluate whether a published psychological effect is overstated due to the file drawer problem.