↓ Skip to main content

Degrees of Freedom in Planning, Running, Analyzing, and Reporting Psychological Studies: A Checklist to Avoid p-Hacking

Overview of attention for article published in Frontiers in Psychology, November 2016
Altmetric Badge

About this Attention Score

  • In the top 5% of all research outputs scored by Altmetric
  • High Attention Score compared to outputs of the same age (99th percentile)
  • High Attention Score compared to outputs of the same age and source (98th percentile)

Mentioned by

news
4 news outlets
blogs
7 blogs
policy
1 policy source
twitter
349 X users
facebook
2 Facebook pages
wikipedia
6 Wikipedia pages
googleplus
1 Google+ user
reddit
1 Redditor
video
1 YouTube creator

Citations

dimensions_citation
492 Dimensions

Readers on

mendeley
783 Mendeley
citeulike
1 CiteULike
You are seeing a free-to-access but limited selection of the activity Altmetric has collected about this research output. Click here to find out more.
Title
Degrees of Freedom in Planning, Running, Analyzing, and Reporting Psychological Studies: A Checklist to Avoid p-Hacking
Published in
Frontiers in Psychology, November 2016
DOI 10.3389/fpsyg.2016.01832
Pubmed ID
Authors

Jelte M. Wicherts, Coosje L. S. Veldkamp, Hilde E. M. Augusteijn, Marjan Bakker, Robbie C. M. van Aert, Marcel A. L. M. van Assen

Abstract

The designing, collecting, analyzing, and reporting of psychological studies entail many choices that are often arbitrary. The opportunistic use of these so-called researcher degrees of freedom aimed at obtaining statistically significant results is problematic because it enhances the chances of false positive results and may inflate effect size estimates. In this review article, we present an extensive list of 34 degrees of freedom that researchers have in formulating hypotheses, and in designing, running, analyzing, and reporting of psychological research. The list can be used in research methods education, and as a checklist to assess the quality of preregistrations and to determine the potential for bias due to (arbitrary) choices in unregistered studies.

X Demographics

X Demographics

The data shown below were collected from the profiles of 349 X users who shared this research output. Click here to find out more about how the information was compiled.
Mendeley readers

Mendeley readers

The data shown below were compiled from readership statistics for 783 Mendeley readers of this research output. Click here to see the associated Mendeley record.

Geographical breakdown

Country Count As %
United Kingdom 4 <1%
Germany 2 <1%
New Zealand 2 <1%
United States 2 <1%
Canada 2 <1%
Chile 1 <1%
Czechia 1 <1%
Sweden 1 <1%
Macao 1 <1%
Other 4 <1%
Unknown 763 97%

Demographic breakdown

Readers by professional status Count As %
Student > Ph. D. Student 180 23%
Student > Master 113 14%
Student > Bachelor 97 12%
Researcher 90 11%
Student > Doctoral Student 59 8%
Other 126 16%
Unknown 118 15%
Readers by discipline Count As %
Psychology 317 40%
Social Sciences 55 7%
Neuroscience 38 5%
Medicine and Dentistry 32 4%
Agricultural and Biological Sciences 24 3%
Other 124 16%
Unknown 193 25%
Attention Score in Context

Attention Score in Context

This research output has an Altmetric Attention Score of 295. This is our high-level measure of the quality and quantity of online attention that it has received. This Attention Score, as well as the ranking and number of research outputs shown below, was calculated when the research output was last mentioned on 18 December 2023.
All research outputs
#119,716
of 25,639,676 outputs
Outputs from Frontiers in Psychology
#248
of 34,719 outputs
Outputs of similar age
#2,501
of 417,789 outputs
Outputs of similar age from Frontiers in Psychology
#5
of 415 outputs
Altmetric has tracked 25,639,676 research outputs across all sources so far. Compared to these this one has done particularly well and is in the 99th percentile: it's in the top 5% of all research outputs ever tracked by Altmetric.
So far Altmetric has tracked 34,719 research outputs from this source. They typically receive a lot more attention than average, with a mean Attention Score of 13.4. This one has done particularly well, scoring higher than 99% of its peers.
Older research outputs will score higher simply because they've had more time to accumulate mentions. To account for age we can compare this Altmetric Attention Score to the 417,789 tracked outputs that were published within six weeks on either side of this one in any source. This one has done particularly well, scoring higher than 99% of its contemporaries.
We're also able to compare this research output to 415 others from the same source and published within six weeks on either side of this one. This one has done particularly well, scoring higher than 98% of its contemporaries.