Title |
Degrees of Freedom in Planning, Running, Analyzing, and Reporting Psychological Studies: A Checklist to Avoid p-Hacking
|
---|---|
Published in |
Frontiers in Psychology, November 2016
|
DOI | 10.3389/fpsyg.2016.01832 |
Pubmed ID | |
Authors |
Jelte M. Wicherts, Coosje L. S. Veldkamp, Hilde E. M. Augusteijn, Marjan Bakker, Robbie C. M. van Aert, Marcel A. L. M. van Assen |
Abstract |
The designing, collecting, analyzing, and reporting of psychological studies entail many choices that are often arbitrary. The opportunistic use of these so-called researcher degrees of freedom aimed at obtaining statistically significant results is problematic because it enhances the chances of false positive results and may inflate effect size estimates. In this review article, we present an extensive list of 34 degrees of freedom that researchers have in formulating hypotheses, and in designing, running, analyzing, and reporting of psychological research. The list can be used in research methods education, and as a checklist to assess the quality of preregistrations and to determine the potential for bias due to (arbitrary) choices in unregistered studies. |
X Demographics
Geographical breakdown
Country | Count | As % |
---|---|---|
United States | 62 | 18% |
United Kingdom | 37 | 11% |
Netherlands | 21 | 6% |
Canada | 15 | 4% |
Germany | 11 | 3% |
Belgium | 9 | 3% |
Australia | 9 | 3% |
Switzerland | 7 | 2% |
Finland | 4 | 1% |
Other | 43 | 12% |
Unknown | 131 | 38% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Members of the public | 181 | 52% |
Scientists | 137 | 39% |
Practitioners (doctors, other healthcare professionals) | 24 | 7% |
Science communicators (journalists, bloggers, editors) | 7 | 2% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
United Kingdom | 4 | <1% |
Germany | 2 | <1% |
New Zealand | 2 | <1% |
United States | 2 | <1% |
Canada | 2 | <1% |
Chile | 1 | <1% |
Czechia | 1 | <1% |
Sweden | 1 | <1% |
Macao | 1 | <1% |
Other | 4 | <1% |
Unknown | 763 | 97% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Student > Ph. D. Student | 180 | 23% |
Student > Master | 113 | 14% |
Student > Bachelor | 97 | 12% |
Researcher | 90 | 11% |
Student > Doctoral Student | 59 | 8% |
Other | 126 | 16% |
Unknown | 118 | 15% |
Readers by discipline | Count | As % |
---|---|---|
Psychology | 317 | 40% |
Social Sciences | 55 | 7% |
Neuroscience | 38 | 5% |
Medicine and Dentistry | 32 | 4% |
Agricultural and Biological Sciences | 24 | 3% |
Other | 124 | 16% |
Unknown | 193 | 25% |