Title |
Cooperation between Referees and Authors Increases Peer Review Accuracy
|
---|---|
Published in |
PLOS ONE, November 2011
|
DOI | 10.1371/journal.pone.0026895 |
Pubmed ID | |
Authors |
Jeffrey T. Leek, Margaret A. Taub, Fernando J. Pineda |
Abstract |
Peer review is fundamentally a cooperative process between scientists in a community who agree to review each other's work in an unbiased fashion. Peer review is the foundation for decisions concerning publication in journals, awarding of grants, and academic promotion. Here we perform a laboratory study of open and closed peer review based on an online game. We show that when reviewer behavior was made public under open review, reviewers were rewarded for refereeing and formed significantly more cooperative interactions (13% increase in cooperation, P = 0.018). We also show that referees and authors who participated in cooperative interactions had an 11% higher reviewing accuracy rate (P = 0.016). Our results suggest that increasing cooperation in the peer review process can lead to a decreased risk of reviewing errors. |
X Demographics
Geographical breakdown
Country | Count | As % |
---|---|---|
United States | 22 | 20% |
United Kingdom | 8 | 7% |
Switzerland | 3 | 3% |
Portugal | 2 | 2% |
Germany | 2 | 2% |
Brazil | 2 | 2% |
Canada | 2 | 2% |
Spain | 1 | <1% |
Costa Rica | 1 | <1% |
Other | 9 | 8% |
Unknown | 58 | 53% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Members of the public | 67 | 61% |
Scientists | 40 | 36% |
Practitioners (doctors, other healthcare professionals) | 2 | 2% |
Science communicators (journalists, bloggers, editors) | 1 | <1% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
United States | 12 | 7% |
United Kingdom | 5 | 3% |
Spain | 5 | 3% |
France | 3 | 2% |
Brazil | 3 | 2% |
Germany | 3 | 2% |
Canada | 3 | 2% |
Argentina | 2 | 1% |
Netherlands | 2 | 1% |
Other | 8 | 5% |
Unknown | 120 | 72% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Researcher | 47 | 28% |
Student > Ph. D. Student | 37 | 22% |
Other | 16 | 10% |
Student > Master | 16 | 10% |
Professor > Associate Professor | 13 | 8% |
Other | 31 | 19% |
Unknown | 6 | 4% |
Readers by discipline | Count | As % |
---|---|---|
Agricultural and Biological Sciences | 45 | 27% |
Social Sciences | 21 | 13% |
Computer Science | 18 | 11% |
Medicine and Dentistry | 13 | 8% |
Psychology | 10 | 6% |
Other | 48 | 29% |
Unknown | 11 | 7% |