Title |
Confidence limits, error bars and method comparison in molecular modeling. Part 2: comparing methods
|
---|---|
Published in |
Perspectives in Drug Discovery and Design, March 2016
|
DOI | 10.1007/s10822-016-9904-5 |
Pubmed ID | |
Authors |
A. Nicholls |
Abstract |
The calculation of error bars for quantities of interest in computational chemistry comes in two forms: (1) Determining the confidence of a prediction, for instance of the property of a molecule; (2) Assessing uncertainty in measuring the difference between properties, for instance between performance metrics of two or more computational approaches. While a former paper in this series concentrated on the first of these, this second paper focuses on comparison, i.e. how do we calculate differences in methods in an accurate and statistically valid manner. Described within are classical statistical approaches for comparing widely used metrics such as enrichment, area under the curve and Pearson's product-moment coefficient, as well as generic measures. These are considered of over single and multiple sets of data and for two or more methods that evince either independent or correlated behavior. General issues concerning significance testing and confidence limits from a Bayesian perspective are discussed, along with size-of-effect aspects of evaluation. |
X Demographics
Geographical breakdown
Country | Count | As % |
---|---|---|
United States | 8 | 53% |
United Kingdom | 1 | 7% |
Comoros | 1 | 7% |
Unknown | 5 | 33% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Scientists | 10 | 67% |
Members of the public | 5 | 33% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
Israel | 1 | 1% |
United States | 1 | 1% |
Sweden | 1 | 1% |
Unknown | 96 | 97% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Researcher | 28 | 28% |
Student > Ph. D. Student | 23 | 23% |
Student > Bachelor | 8 | 8% |
Student > Master | 5 | 5% |
Professor | 4 | 4% |
Other | 11 | 11% |
Unknown | 20 | 20% |
Readers by discipline | Count | As % |
---|---|---|
Chemistry | 36 | 36% |
Agricultural and Biological Sciences | 13 | 13% |
Biochemistry, Genetics and Molecular Biology | 9 | 9% |
Computer Science | 6 | 6% |
Chemical Engineering | 2 | 2% |
Other | 9 | 9% |
Unknown | 24 | 24% |