Title |
Marginally Significant Effects as Evidence for Hypotheses
|
---|---|
Published in |
Psychological Science, May 2016
|
DOI | 10.1177/0956797616645672 |
Pubmed ID | |
Authors |
Laura Pritschet, Derek Powell, Zachary Horne |
Abstract |
Some effects are statistically significant. Other effects do not reach the threshold of statistical significance and are sometimes described as "marginally significant" or as "approaching significance." Although the concept of marginal significance is widely deployed in academic psychology, there has been very little systematic examination of psychologists' attitudes toward these effects. Here, we report an observational study in which we investigated psychologists' attitudes concerning marginal significance by examining their language in over 1,500 articles published in top-tier cognitive, developmental, and social psychology journals. We observed a large change over the course of four decades in psychologists' tendency to describe a p value as marginally significant, and overall rates of use appear to differ across subfields. We discuss possible explanations for these findings, as well as their implications for psychological research. |
X Demographics
Geographical breakdown
Country | Count | As % |
---|---|---|
United States | 20 | 15% |
United Kingdom | 14 | 10% |
Japan | 8 | 6% |
Spain | 6 | 4% |
Germany | 5 | 4% |
Australia | 5 | 4% |
Canada | 4 | 3% |
Sweden | 2 | 1% |
Netherlands | 2 | 1% |
Other | 13 | 10% |
Unknown | 56 | 41% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Members of the public | 75 | 56% |
Scientists | 41 | 30% |
Practitioners (doctors, other healthcare professionals) | 13 | 10% |
Science communicators (journalists, bloggers, editors) | 6 | 4% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
Germany | 2 | <1% |
United States | 2 | <1% |
Japan | 2 | <1% |
Brazil | 2 | <1% |
Canada | 2 | <1% |
Austria | 1 | <1% |
Czechia | 1 | <1% |
Hungary | 1 | <1% |
Chile | 1 | <1% |
Other | 2 | <1% |
Unknown | 291 | 95% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Student > Ph. D. Student | 75 | 24% |
Student > Master | 44 | 14% |
Researcher | 38 | 12% |
Student > Doctoral Student | 24 | 8% |
Student > Bachelor | 20 | 7% |
Other | 61 | 20% |
Unknown | 45 | 15% |
Readers by discipline | Count | As % |
---|---|---|
Psychology | 139 | 45% |
Social Sciences | 24 | 8% |
Business, Management and Accounting | 19 | 6% |
Linguistics | 9 | 3% |
Computer Science | 8 | 3% |
Other | 50 | 16% |
Unknown | 58 | 19% |