| Title |
Comparing Amazon’s Mechanical Turk Platform to Conventional Data Collection Methods in the Health and Medical Research Literature
|
|---|---|
| Published in |
Journal of General Internal Medicine, January 2018
|
| DOI | 10.1007/s11606-017-4246-0 |
| Pubmed ID | |
| Authors |
Karoline Mortensen, Taylor L. Hughes |
| Abstract |
The goal of this article is to conduct an assessment of the peer-reviewed primary literature with study objectives to analyze Amazon.com 's Mechanical Turk (MTurk) as a research tool in a health services research and medical context. Searches of Google Scholar and PubMed databases were conducted in February 2017. We screened article titles and abstracts to identify relevant articles that compare data from MTurk samples in a health and medical context to another sample, expert opinion, or other gold standard. Full-text manuscript reviews were conducted for the 35 articles that met the study criteria. The vast majority of the studies supported the use of MTurk for a variety of academic purposes. The literature overwhelmingly concludes that MTurk is an efficient, reliable, cost-effective tool for generating sample responses that are largely comparable to those collected via more conventional means. Caveats include survey responses may not be generalizable to the US population. |
X Demographics
The data shown below were collected from the profile of 1 X user who shared this research output. Click here to find out more about how the information was compiled.
Geographical breakdown
| Country | Count | As % |
|---|---|---|
| Unknown | 1 | 100% |
Demographic breakdown
| Type | Count | As % |
|---|---|---|
| Science communicators (journalists, bloggers, editors) | 1 | 100% |
Mendeley readers
The data shown below were compiled from readership statistics for 169 Mendeley readers of this research output. Click here to see the associated Mendeley record.
Geographical breakdown
| Country | Count | As % |
|---|---|---|
| Unknown | 169 | 100% |
Demographic breakdown
| Readers by professional status | Count | As % |
|---|---|---|
| Student > Ph. D. Student | 27 | 16% |
| Researcher | 23 | 14% |
| Student > Doctoral Student | 19 | 11% |
| Student > Bachelor | 14 | 8% |
| Student > Master | 13 | 8% |
| Other | 29 | 17% |
| Unknown | 44 | 26% |
| Readers by discipline | Count | As % |
|---|---|---|
| Medicine and Dentistry | 24 | 14% |
| Psychology | 21 | 12% |
| Social Sciences | 13 | 8% |
| Engineering | 8 | 5% |
| Nursing and Health Professions | 7 | 4% |
| Other | 38 | 22% |
| Unknown | 58 | 34% |
Attention Score in Context
This research output has an Altmetric Attention Score of 1. This is our high-level measure of the quality and quantity of online attention that it has received. This Attention Score, as well as the ranking and number of research outputs shown below, was calculated when the research output was last mentioned on 28 February 2018.
All research outputs
#21,420,714
of 23,911,072 outputs
Outputs from Journal of General Internal Medicine
#7,217
of 7,806 outputs
Outputs of similar age
#385,789
of 449,043 outputs
Outputs of similar age from Journal of General Internal Medicine
#123
of 140 outputs
Altmetric has tracked 23,911,072 research outputs across all sources so far. This one is in the 1st percentile – i.e., 1% of other outputs scored the same or lower than it.
So far Altmetric has tracked 7,806 research outputs from this source. They typically receive a lot more attention than average, with a mean Attention Score of 21.8. This one is in the 1st percentile – i.e., 1% of its peers scored the same or lower than it.
Older research outputs will score higher simply because they've had more time to accumulate mentions. To account for age we can compare this Altmetric Attention Score to the 449,043 tracked outputs that were published within six weeks on either side of this one in any source. This one is in the 1st percentile – i.e., 1% of its contemporaries scored the same or lower than it.
We're also able to compare this research output to 140 others from the same source and published within six weeks on either side of this one. This one is in the 1st percentile – i.e., 1% of its contemporaries scored the same or lower than it.