Title |
SNOOP: A program for demonstrating the consequences of premature and repeated null hypothesis testing
|
---|---|
Published in |
Behavior Research Methods, February 2006
|
DOI | 10.3758/bf03192746 |
Pubmed ID | |
Authors |
Michael J Strube |
Abstract |
The ease with which data can be collected and analyzed via personal computer makes it potentially attractive to "peek" at the data before a target sample size is achieved. This tactic might seem appealing because data collection could be stopped early, which would save valuable resources, if a peek revealed a significant effect. Unfortunately, such data snooping comes with a cost. When the null hypothesis is true, the Type I error rate is inflated, sometimes quite substantially. If the null hypothesis is false, premature significance testing leads to inflated estimates of power and effect size. This program provides simulation results for a wide variety of premature and repeated null hypothesis testing scenarios. It gives researchers the ability to know in advance the consequences of data peeking so that appropriate corrective action can be taken. |
X Demographics
Geographical breakdown
Country | Count | As % |
---|---|---|
United Kingdom | 3 | 43% |
United States | 2 | 29% |
Australia | 1 | 14% |
Japan | 1 | 14% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Members of the public | 6 | 86% |
Practitioners (doctors, other healthcare professionals) | 1 | 14% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
United Kingdom | 2 | 3% |
Netherlands | 1 | 1% |
India | 1 | 1% |
Germany | 1 | 1% |
Unknown | 70 | 93% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Student > Ph. D. Student | 22 | 29% |
Researcher | 16 | 21% |
Professor > Associate Professor | 6 | 8% |
Professor | 5 | 7% |
Student > Bachelor | 4 | 5% |
Other | 11 | 15% |
Unknown | 11 | 15% |
Readers by discipline | Count | As % |
---|---|---|
Psychology | 34 | 45% |
Medicine and Dentistry | 6 | 8% |
Agricultural and Biological Sciences | 5 | 7% |
Social Sciences | 4 | 5% |
Neuroscience | 2 | 3% |
Other | 8 | 11% |
Unknown | 16 | 21% |