The p value is the probability of the experiment having given the result it did purely by chance. The threshold of significance is almost always 0.05 so that if the probability of a chance outcome is less than 1 in 20, the experimental result is declared to be significant. There are other important thresholds as summarized in the following table

p value

Having devised an experiment that is simple to analyse, it is important also not to fall at the final hurdle of interpreting the results of the statistical tests.

Arizona State University

School of Visual Arts

It is essential for an experiment to succeed. Statistics are needed to help identify differences outcome between testing conditions are systematic and meaningfully related to the independent variable.

Statistical Analysis

Knowing there are pretty dangerous pitfalls in statistical analysis and that statistics is a challenging area to master: so, it should follow keep it simple stupid (KISS). Simpler experiments are actually more severe tests because there is nowhere to hide: something either clearly passes the test or it does not.

Safe Analysis

Interpreting Analysis

What statistics can indicate is some results are perhaps more unlikely than might be expected and therefore worthy of further investigation.
Experiments can be exploring the possible influences of many factors on particular interactions or experiential outcomes. Statistics cannot possibly provide evidence in support of any particular factor influencing the outcome of the experiment. 


Learn Before

Related

Learn After