Title |
Common misconceptions about data analysis and statistics
|
---|---|
Published in |
Naunyn-Schmiedeberg's Archives of Pharmacology, September 2014
|
DOI | 10.1007/s00210-014-1037-6 |
Pubmed ID | |
Authors |
Harvey J. Motulsky |
Abstract |
Ideally, any experienced investigator with the right tools should be able to reproduce a finding published in a peer-reviewed biomedical science journal. In fact, the reproducibility of a large percentage of published findings has been questioned. Undoubtedly, there are many reasons for this, but one reason maybe that investigators fool themselves due to a poor understanding of statistical concepts. In particular, investigators often make these mistakes: 1. P-Hacking. This is when you reanalyze a data set in many different ways, or perhaps reanalyze with additional replicates, until you get the result you want. 2. Overemphasis on P values rather than on the actual size of the observed effect. 3. Overuse of statistical hypothesis testing, and being seduced by the word "significant". 4. Overreliance on standard errors, which are often misunderstood. |
X Demographics
Geographical breakdown
Country | Count | As % |
---|---|---|
United States | 11 | 22% |
United Kingdom | 9 | 18% |
Australia | 2 | 4% |
Portugal | 2 | 4% |
France | 1 | 2% |
Germany | 1 | 2% |
Switzerland | 1 | 2% |
Turkey | 1 | 2% |
Canada | 1 | 2% |
Other | 2 | 4% |
Unknown | 18 | 37% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Scientists | 24 | 49% |
Members of the public | 21 | 43% |
Science communicators (journalists, bloggers, editors) | 3 | 6% |
Practitioners (doctors, other healthcare professionals) | 1 | 2% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
United States | 2 | 2% |
Sweden | 1 | <1% |
Germany | 1 | <1% |
Unknown | 118 | 97% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Student > Ph. D. Student | 33 | 27% |
Researcher | 26 | 21% |
Student > Master | 15 | 12% |
Professor > Associate Professor | 8 | 7% |
Other | 7 | 6% |
Other | 21 | 17% |
Unknown | 12 | 10% |
Readers by discipline | Count | As % |
---|---|---|
Agricultural and Biological Sciences | 33 | 27% |
Medicine and Dentistry | 18 | 15% |
Psychology | 11 | 9% |
Neuroscience | 9 | 7% |
Biochemistry, Genetics and Molecular Biology | 6 | 5% |
Other | 24 | 20% |
Unknown | 21 | 17% |